-- Logs begin at Thu 2022-04-07 16:23:18 UTC, end at Thu 2022-04-07 18:06:00 UTC. -- Apr 07 17:10:05.275634 dv-cinder-836996-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 07 17:10:05.283031 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 7 17:10:05 2022] *** Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: nodename: dv-cinder-836996-1-iscsi Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: machine: x86_64 Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: clock source: unix Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: pcre jit disabled Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: detected number of CPU cores: 4 Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: current working directory: / Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: detected binary path: /usr/bin/uwsgi-core Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: your processes number limit is 47680 Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: your memory page size is 4096 bytes Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: detected max file descriptor number: 2048 Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: lock engine: pthread robust mutexes Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: thunder lock: enabled Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 07 17:10:05.287344 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 07 17:10:05.335483 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: Python main interpreter initialized at 0x55f170e6f9c0 Apr 07 17:10:05.335483 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: python threads support enabled Apr 07 17:10:05.335483 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: your server socket listen backlog is limited to 100 connections Apr 07 17:10:05.335483 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: your mercy for graceful operations on workers is 90 seconds Apr 07 17:10:05.335852 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: mapped 403077 bytes (393 KB) for 2 cores Apr 07 17:10:05.335942 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: *** Operational MODE: preforking *** Apr 07 17:10:05.336149 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: *** uWSGI is running in multiple interpreter mode *** Apr 07 17:10:05.336149 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: spawned uWSGI master process (pid: 103275) Apr 07 17:10:05.336348 dv-cinder-836996-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 07 17:10:05.337752 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: spawned uWSGI worker 1 (pid: 103276, cores: 1) Apr 07 17:10:05.337752 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: spawned uWSGI worker 2 (pid: 103277, cores: 1) Apr 07 17:10:05.337752 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 07 17:10:06.535834 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 17:10:06.560316 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 17:10:07.389097 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:10:07.389097 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: from cryptography.utils import int_from_bytes Apr 07 17:10:07.389465 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:10:07.389465 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: from cryptography.utils import int_from_bytes Apr 07 17:10:07.392097 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:10:07.392097 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: from cryptography.utils import int_from_bytes Apr 07 17:10:07.392434 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:10:07.392434 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: from cryptography.utils import int_from_bytes Apr 07 17:10:09.938813 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 17:10:09.939374 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 17:10:09.939582 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 17:10:09.939942 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 17:10:09.940199 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 17:10:09.940618 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.941104 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.941287 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 17:10:09.941662 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.941754 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 17:10:09.941840 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.941971 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 17:10:09.942081 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.942334 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 17:10:09.942421 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.942593 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 17:10:09.942700 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.942982 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.943077 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.943310 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.943403 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.943574 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.943658 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.943890 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.943984 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.944213 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-1-iscsi {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.944306 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.944533 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.944624 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.944837 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.944935 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.945170 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.945271 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.945481 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.945567 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.945750 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.945913 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.946074 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.946206 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.946381 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.946470 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-1-iscsi {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.946704 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.946878 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.947012 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948000 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948098 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948184 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948260 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948335 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948400 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948469 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948534 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948609 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948675 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.948814 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.949027 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.949150 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.949363 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.949472 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.949671 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.949765 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.949982 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.950074 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.950321 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.950438 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-1-iscsi {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.950638 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.950756 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.950948 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.951069 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.951269 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.951381 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.951578 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.951787 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.951904 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.952098 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.952214 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.952408 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.952610 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-1-iscsi {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.952728 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.952927 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.953046 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.953274 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.953363 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.953591 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.953678 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.953989 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.954071 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.954303 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.954388 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.954615 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.954700 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.954914 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.955004 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.955221 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.955313 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.955527 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.955617 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.955843 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.955959 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.956146 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.956334 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.956576 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957016 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957016 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957251 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957333 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957411 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957539 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957627 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957749 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.957841 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958068 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958160 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958322 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958407 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958572 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958658 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958889 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.958980 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.959203 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.959299 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.959512 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.959602 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.959819 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.959911 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.960127 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.960225 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.960381 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.960465 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.960633 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.960719 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.960954 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.961039 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.961301 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.961392 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.961616 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.961757 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.961927 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.962013 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.962237 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.962319 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.962547 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.962631 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.962853 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.962937 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.963160 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.963249 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.963469 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.963554 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.963778 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.963864 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.964089 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.964178 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.964403 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.964495 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.964730 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.964822 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.965036 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.965127 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.965377 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.965475 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.965700 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.965791 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.966008 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.966099 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.966313 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.966410 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.966621 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.966705 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.966939 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.967031 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.967257 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.967352 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.967559 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.967684 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.967812 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.967904 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.968112 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.968205 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.968418 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.968501 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.968735 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.968819 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.969043 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.969128 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.969376 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.969470 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.969682 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.969767 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.969962 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.970054 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.970266 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.970350 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.970570 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.970659 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.970876 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.970961 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.971183 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.971267 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.971489 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.971575 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.971791 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.972400 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.972907 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973004 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973084 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973222 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973307 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973390 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973535 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973660 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973846 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.973982 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.974158 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.974290 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.974464 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.974598 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.974775 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.974917 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.975079 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.975212 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.975373 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.975531 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.975694 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.975839 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.976013 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.976146 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.976322 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.976468 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.976629 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.976796 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.976937 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.977067 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.977278 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.977395 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.977601 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.977695 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.977911 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.978000 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.978219 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.978309 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.978539 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.978635 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.978850 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.978941 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.979155 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.979240 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.979472 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.979573 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.979781 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.979866 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.980082 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.980164 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.980385 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.980471 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.980684 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.980773 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.980986 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.981068 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.981311 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.981399 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.981615 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.981699 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.981915 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.981999 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.982218 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.982303 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.982522 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.982607 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.982826 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.982908 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.983128 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.983212 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.983430 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.983515 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.983732 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.983828 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.984030 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.984120 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.984349 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.984433 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.984659 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.984751 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.984968 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.985053 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.985301 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.985389 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.985608 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.985706 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.985926 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:10:09.986012 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.986261 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.986345 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.986575 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.986662 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.986899 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.986989 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.987209 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.987293 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.988112 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.988600 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.988689 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.988763 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.988844 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.988962 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.989094 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.989309 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.989452 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.989631 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.989776 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.989964 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.990096 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.990282 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.990418 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.990598 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.990729 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.990915 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.991048 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.991241 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.991374 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.991567 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.991699 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.991901 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.991999 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.992221 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.992337 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.992543 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.992679 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.992867 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.992993 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.993204 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.993346 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.993531 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.993679 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.993862 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.993992 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.994187 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.994315 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.994501 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.994636 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.994845 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.994974 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.995189 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.995322 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.995500 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.995637 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.995816 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.995955 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.996128 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.996258 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.996438 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.996593 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.996743 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.996871 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.997045 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.997220 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.997386 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.997526 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.997718 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.997850 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.998031 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.998163 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.998348 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.998489 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.998660 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.998786 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.998972 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.999102 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.999284 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.999453 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.999595 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.999687 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.999907 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:09.999993 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.000209 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.000301 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.000510 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.000601 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.000810 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.000895 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.001119 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.001272 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.001443 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.001540 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.001760 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.001852 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.002080 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.002172 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.002383 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.002470 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.002689 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.002773 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.002994 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.003139 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.003662 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.003750 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.003828 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.003906 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.004039 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.004128 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.004361 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.004447 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.004694 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.004792 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.005005 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.005096 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.005334 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.005421 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.005660 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.005756 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.005971 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.006063 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.006276 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.006366 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.006584 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.006724 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.006889 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.006980 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.007192 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.007279 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.007501 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.007594 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.007808 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.007894 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.008117 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.008224 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.008430 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.008516 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.008737 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.008832 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.009057 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.009237 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.009404 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.009502 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.009683 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.009770 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.010002 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.010088 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.010313 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.010410 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.010626 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.010711 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.010939 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.011025 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.011254 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.011341 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.011579 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.011665 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.011894 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.011989 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.012202 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.012307 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.012509 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.012603 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.012814 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.012907 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.013117 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.013223 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.013451 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.013537 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.013754 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.013848 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.014057 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.014142 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.014359 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.014446 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.014661 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.014755 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.014964 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.015049 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.015277 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.015360 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.015584 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.015670 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.015887 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.016019 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.016187 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.016347 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.016493 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.016625 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.016866 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017006 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017169 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017300 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017444 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017588 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017719 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017850 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.017989 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.018126 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.018290 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.018422 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.018588 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.018714 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.019054 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.019430 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.019514 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.019599 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.019685 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.019764 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.019960 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.020055 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.020288 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.020412 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.020610 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.020695 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.020922 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.021016 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.021261 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.021351 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.021571 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.021656 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.021883 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.021980 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.022191 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.022276 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.022506 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.022591 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.022808 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.022901 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.023123 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.023212 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.023436 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.023526 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.023760 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.023846 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.024075 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.024160 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.024390 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.024473 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.024700 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.024787 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.025013 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.025097 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.025599 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.025704 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.025911 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.025998 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.026221 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.026314 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.026533 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.026618 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.026851 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.026993 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.027161 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.027254 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.027479 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.027573 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.027787 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.027873 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.028095 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.028179 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.028401 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.028560 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.028714 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.028806 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.029013 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.029096 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.029350 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.029450 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.029682 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.029767 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.030005 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.030089 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.030312 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.030408 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.030623 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.030708 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.030935 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.031018 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.031240 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.031339 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.031550 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.031633 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.031857 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.031947 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.032160 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.032254 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.032463 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.032548 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.032770 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.032854 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.033083 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.033189 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.033415 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.033500 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.033725 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.033809 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.034028 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.034115 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.034875 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.035407 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.035500 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.035580 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.035580 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.035734 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.035812 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.035889 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.036062 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.036161 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.036374 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.036466 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.036682 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.036765 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.036984 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.037126 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.037325 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.037413 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.037625 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.037708 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.037926 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.038020 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.038229 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.038313 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.038538 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.038622 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.038840 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.038989 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.039126 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.039255 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.039431 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.039559 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.039768 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.039909 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.040072 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.040164 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.040376 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.040459 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.040689 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.040782 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.040996 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.041079 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.041326 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.041413 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.041631 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.041724 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.041935 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.042018 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.042241 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.042325 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.042559 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.042645 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.042863 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.042946 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.043168 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.043258 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.043477 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.043561 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.043784 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.043868 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.044090 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.044181 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.044398 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.044484 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.044707 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.044789 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.045011 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.045106 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.045344 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.045431 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.045653 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.045739 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.045954 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.046053 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.046263 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.046356 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.046574 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.046658 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.046888 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.047146 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.047244 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.047483 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.047568 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.047802 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.047896 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.048111 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.048194 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.048416 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.048507 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.048728 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.048866 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.049059 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.049176 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.049399 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.049642 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.049729 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.050059 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051147 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051234 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051312 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051312 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051449 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051527 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051612 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051778 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.051866 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.052083 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.052169 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.052389 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.052475 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.052693 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.052777 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.053000 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.053095 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.053325 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.053413 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.053626 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.053715 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.053928 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.054013 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.054228 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.054326 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.054542 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.054627 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.054844 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.054929 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.055155 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.055248 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.055457 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.055551 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.055759 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.055853 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.056064 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.056161 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.056364 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.056456 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.056665 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.056748 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.056967 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.057064 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.057299 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.057387 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.057614 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.057699 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.057920 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.058014 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.058245 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.058333 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.058557 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.058642 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.058863 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.058950 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.059163 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.059247 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.059474 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.059565 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.059777 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.059920 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.060078 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.060215 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.060380 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.060508 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.060692 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.060830 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.060999 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.061130 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.061356 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.061498 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.061631 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.061763 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.061916 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.062057 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.062224 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.062361 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.062532 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.062661 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.062836 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.062966 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.063144 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.063281 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.063447 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.063582 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.063749 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.063888 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.064056 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.064196 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.064357 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.064494 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.064659 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.064805 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.064966 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.065098 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.065295 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.065424 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.065618 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.066346 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067307 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067452 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067547 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067627 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067705 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067782 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067869 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.067950 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068027 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068104 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068180 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068264 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068352 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068432 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068510 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068510 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068653 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068653 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068818 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068896 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.068979 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.069185 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.069326 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.069474 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.069608 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.069775 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.069917 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.070077 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.070204 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.070378 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.070512 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.070685 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.070819 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.070989 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.071118 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.071305 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.071439 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.071607 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.071743 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.071909 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.072050 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.072210 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.072342 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.072512 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.072652 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.072812 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.072952 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.073117 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.073267 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.073439 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.073587 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.073740 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.073878 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.074040 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.074168 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.074340 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.074470 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.074641 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.074779 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.074968 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.075103 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.075248 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.075335 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.075549 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.075634 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.075851 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.075936 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.076150 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.076241 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.076454 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.076540 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.076758 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.076843 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.077061 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.077170 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.077391 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.077521 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.077716 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.077809 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.078029 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.078115 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.078334 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.078428 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.078639 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.078731 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.078944 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.079038 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.079244 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.079330 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.079560 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.079652 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.079871 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.079963 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.080210 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.080302 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.080485 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.080570 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.080793 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.080886 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.081113 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.081344 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.081763 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.081850 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.081929 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.082019 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.082156 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.082243 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.082477 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.082569 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.082793 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.082887 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.083096 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.083180 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.083404 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.083527 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.083710 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.083795 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.084016 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.084110 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.084327 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.084412 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.084636 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.084721 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.084947 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.085032 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.085287 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.085379 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.085601 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.085696 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.085905 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.085995 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.086214 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.086304 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.086519 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.086619 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.086825 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.086911 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.087131 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.087226 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.087434 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.087566 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.087746 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.087839 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.088052 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.088148 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.088354 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.088439 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.088660 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.088746 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.088966 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.089067 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.089298 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.089393 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.089600 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.089691 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.089909 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.090049 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.090218 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.090310 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.090544 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.090637 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.090857 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.090945 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.091164 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.091258 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.091475 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.091560 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.091782 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.091877 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.092098 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.092183 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.092398 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.092482 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.092812 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.092899 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.093126 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.093266 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.093457 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.093544 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.093764 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.093852 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.094063 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.094148 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.094363 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.094462 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.094672 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.094758 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.094987 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.095071 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.095286 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.095387 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.095588 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.095710 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.095889 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.096028 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.096209 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.096344 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.096509 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.096658 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.097367 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.097649 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.097923 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.098056 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.098205 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.098309 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.098511 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.098614 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.098847 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.098936 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.099157 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.099244 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.099464 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.099553 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.099793 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.099883 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.100101 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.100205 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.100425 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.100520 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.100773 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.100861 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.101028 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.101127 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.101367 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.101468 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.101691 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.101858 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.102014 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.102173 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.102334 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.102484 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.102628 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.102797 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.102931 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.103121 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.103251 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.103449 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.103572 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.103756 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.103887 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.104073 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.104209 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.104386 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.104620 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.104717 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.104942 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.105030 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.105282 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.105388 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.105601 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.105761 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.105926 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.106015 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.106229 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.106317 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.106532 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.106621 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.106840 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.106927 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.107142 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.107229 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.107445 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.107582 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.107769 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.107910 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.108061 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.108226 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.108373 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.108550 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.108684 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.108878 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.108990 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.109210 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.109315 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.109527 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.109616 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.109841 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.109929 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.110152 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.110242 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.110462 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.110551 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.110787 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.110876 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.111094 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.111184 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.111409 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.111498 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.111710 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.111805 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.112023 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.112111 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.112326 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.112442 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.113243 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.113360 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.113571 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.113743 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.113871 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.114094 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.114183 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.114486 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.114582 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.114812 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.114901 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.115135 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.115224 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.115443 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.115545 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.115784 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.115873 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.116099 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.116186 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.116408 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.116497 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.116714 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.116803 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.117022 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.117111 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.117373 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.117462 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.117691 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.117778 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.117996 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.118106 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.118297 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.118387 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.118607 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.118695 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.118910 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.119006 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.119212 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.119301 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.119517 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.119605 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.119822 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.119919 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.120124 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.120213 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.120424 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.120526 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.120722 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.120825 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.121042 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.121131 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.121370 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.121461 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.121692 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.121789 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122004 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122091 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122308 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122402 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122611 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122701 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122912 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.122998 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.123219 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.123310 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.123522 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.123618 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.123844 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.123969 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.124150 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.124239 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.124472 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.124565 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.124780 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.124867 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.125085 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.125210 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.125431 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.125531 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.125737 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.125895 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.126055 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.126151 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.126373 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.126461 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.126691 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.126779 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.127008 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.127106 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.127325 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.127414 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.127642 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.127729 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.127952 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.128145 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.128412 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.128501 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.128787 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.128878 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.129112 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.129263 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.129463 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.129653 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.129787 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.129982 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.130108 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.130299 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.130432 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.130639 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.130779 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.130924 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.131071 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.131215 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.131352 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.131525 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.131686 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.131826 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.131972 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.132135 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.132444 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.132589 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.132756 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.132903 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.133085 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.133196 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.133430 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.133519 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.133746 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.133847 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.134067 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.134157 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.134382 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.134468 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.134696 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.134800 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.135011 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.135108 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.135321 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.135410 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.135632 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.135721 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.135963 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.136053 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.136267 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.136368 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.136581 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.136671 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.136900 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.136988 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.137237 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.137343 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.137553 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.137642 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.137865 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.137955 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.138177 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.138276 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.138486 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.138587 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.138795 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.138892 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.139104 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.139209 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.139417 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.139505 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.139729 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.139817 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.140051 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.140140 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.140372 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.140476 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.140690 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.140791 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.140997 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.141092 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.141341 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.141438 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.141656 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.141754 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.141967 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.142177 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.142266 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.142490 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.142578 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.142820 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.142922 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.143142 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.143230 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.143465 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.143553 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.143822 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.143916 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.144143 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.144301 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.144468 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.144558 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.144771 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.145076 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.145201 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.145411 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.145500 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.145718 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.145809 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.146020 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.146109 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.146341 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.146429 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.146650 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.146739 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.146954 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.147042 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.147270 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.147370 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.147578 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.147668 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.147884 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.148111 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.148199 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.148461 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.148572 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.148782 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.148872 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.149103 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.149220 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.149443 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.149541 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.149758 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.149847 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.150064 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.150151 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.150635 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.150785 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.150939 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.151168 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.151257 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.151516 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.151612 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.151835 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.151925 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.152137 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.152223 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.152443 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.152584 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.152754 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.152844 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.153064 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.153171 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.153391 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.153482 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.153701 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.153788 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.154006 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.154094 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.154326 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.154414 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.154630 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.154717 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.154933 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.155020 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.155235 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.155330 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.155546 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.155633 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.155850 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.155945 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.156151 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.156239 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.156450 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.156544 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.156755 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.156853 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.157067 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.157201 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.157394 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.157498 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.157699 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.157796 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.157999 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.158093 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.158309 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.158443 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.158611 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.158708 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.158914 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.159002 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.159221 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.159807 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.160047 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.160146 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.160359 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.160447 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.160662 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.160750 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.160973 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.161076 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.161300 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.161391 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.161615 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.161703 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.161924 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.162015 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.162234 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.162328 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.162579 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.162674 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.162894 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.162984 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.163200 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.163428 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.163517 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.163765 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.163863 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.164088 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.164177 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.164419 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.164508 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.164733 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.164822 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.165043 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.165130 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.165370 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.165460 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.165675 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.165766 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.165999 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.166248 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.166337 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.166587 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.166688 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.166900 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.166987 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.167208 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.167295 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.167517 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.167615 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.167826 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.167915 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.168134 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.168223 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.168441 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.168577 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.168746 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.168841 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.169053 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.169161 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.169382 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.169484 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.169688 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.169776 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.170001 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.170089 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.170313 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.170409 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.170628 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.170716 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.170939 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.171041 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.171252 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.171348 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.171561 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.171648 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.171872 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.171968 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.172181 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.172270 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.172489 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.172584 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.172797 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.172966 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.173112 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.173240 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.173464 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.173554 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.173777 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.173867 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.174081 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.174168 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.174405 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.174541 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.174720 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.174811 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.175621 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.175789 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.175939 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.176249 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.176358 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.176570 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.176660 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.176895 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.177009 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.177237 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.177335 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.177547 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.177651 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.177867 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.177963 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.178180 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.178277 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.178511 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.178613 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.178851 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.178948 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.179180 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.179269 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.179502 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.179596 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.179806 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.179900 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.180113 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.180203 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.180419 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.180507 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.180731 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.180832 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.181051 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.181182 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.181385 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.181474 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.181696 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.181798 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.182001 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.182099 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.182310 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.182399 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.182615 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.182717 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.182920 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.183020 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.183224 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.183312 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.183527 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.183617 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.183835 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.183923 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.184136 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.184226 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.184437 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.184537 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.184740 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.184844 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.185041 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.185130 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.185369 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.185460 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.185673 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.185760 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.185981 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.186080 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.186283 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.186371 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.186583 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.186670 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.186885 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.186981 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.187188 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.187286 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.187486 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.187580 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.187787 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.187883 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.188093 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.188182 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.188402 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.188497 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.188711 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.188871 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.189016 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.189113 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.189350 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.189447 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.189656 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.189758 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.189965 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.190054 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.190290 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.190377 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.190645 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.190756 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.191063 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.191182 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.191388 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.191486 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.191705 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.191794 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.192019 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.192114 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.192330 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.192425 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.192668 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.192762 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.192950 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.193051 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.193279 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.193386 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.193592 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.193686 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.193919 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.194005 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.194224 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.194326 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.194539 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.194648 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.194857 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.194957 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.195168 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.195275 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.195482 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.195578 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.195793 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.195880 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.196121 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.196216 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.196431 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.196519 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.196743 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.196831 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.197062 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.197175 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.197400 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.197489 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.197711 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.197808 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.198029 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.198117 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.198345 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.198432 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.198672 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.198766 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.198988 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.199085 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.199301 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.199391 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.199622 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.199719 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.199943 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.200031 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.200258 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.200346 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.200578 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.200674 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.200899 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.200987 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.201231 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.201333 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.201553 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.201658 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.201857 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.201946 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.202099 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 17:10:10.202195 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.202545 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.202865 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.203215 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.203543 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.203859 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.204173 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.204481 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:10:10.204724 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103277) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 17:10:10.226540 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:10.229859 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_db.sqlalchemy.engines [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:10.288874 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.context [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8571387-67cb-4f0b-96d4-8f5caf004dc2(cell1) {{(pid=103276) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 17:10:10.292613 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.context [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8571387-67cb-4f0b-96d4-8f5caf004dc2(cell1) {{(pid=103277) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 17:10:10.294640 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:10:10.296242 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:10:10.297049 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:10:10.298559 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_concurrency.lockutils [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:10:10.298991 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:10:10.300256 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_concurrency.lockutils [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:10:10.301089 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_concurrency.lockutils [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:10:10.303132 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_concurrency.lockutils [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103277) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:10:10.309773 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:10.310791 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:10.315373 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_db.sqlalchemy.engines [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:10.318136 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_db.sqlalchemy.engines [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:10.473241 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:10.476776 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG oslo_db.sqlalchemy.engines [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103277) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:10:11.006001 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: WARNING keystonemiddleware.auth_token [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:10:11.012578 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: WARNING keystonemiddleware.auth_token [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:10:11.035778 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:10:11.042292 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:10:11.234046 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: WARNING keystonemiddleware.auth_token [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:10:11.239859 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: WARNING keystonemiddleware.auth_token [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:10:11.244938 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f170e6f9c0 pid: 103277 (default app) Apr 07 17:10:11.247007 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:10:11.248164 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001715 Apr 07 17:10:11.248571 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Thu Apr 7 17:10:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:10:11.270423 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:10:11.275685 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-4256e9de-61b5-4bfa-b7a1-2c99b6da63cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:10:11.281004 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f170e6f9c0 pid: 103276 (default app) Apr 07 17:11:33.407848 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:33.413830 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Apr 07 17:11:33.413830 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:33.851621 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-3ffe3ccf-5877-4a59-982f-9070f169db04 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:33.882702 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-3ffe3ccf-5877-4a59-982f-9070f169db04 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.465696 Apr 07 17:11:33.883582 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Apr 7 17:11:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:11:36.264006 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:36.265175 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-59dc87c9-6484-47ed-803f-c4634c622625 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Apr 07 17:11:36.265766 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:36.326667 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-7d6ec41d-aabc-44b2-b4e0-d26ce5a13e7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:36.346016 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:11:36.346016 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Apr 07 17:11:36.449305 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-7d6ec41d-aabc-44b2-b4e0-d26ce5a13e7f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.177098 Apr 07 17:11:36.450289 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:11:36.673308 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-9c70b73c-654d-4f96-b75f-d23fcf328b24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:36.673519 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:11:36.673519 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: warnings.warn(msg) Apr 07 17:11:36.796728 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-9c70b73c-654d-4f96-b75f-d23fcf328b24 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.337213 Apr 07 17:11:36.797592 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Apr 7 17:11:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:11:39.172669 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-7d6ec41d-aabc-44b2-b4e0-d26ce5a13e7f admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:39.173811 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-7d6ec41d-aabc-44b2-b4e0-d26ce5a13e7f admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003607 Apr 07 17:11:39.174293 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:39.299496 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-f33db1bb-b42a-4dcb-8fab-82f991cb1c0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "vcpus": 1}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:39.318799 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:11:39.318799 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: warnings.warn(msg) Apr 07 17:11:39.415725 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-f33db1bb-b42a-4dcb-8fab-82f991cb1c0a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.235515 Apr 07 17:11:39.416284 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 17:11:39.429440 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-2c7ca9e0-e781-43a9-b7e7-520e743519c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:39.431158 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:11:39.431158 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Apr 07 17:11:39.544600 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-2c7ca9e0-e781-43a9-b7e7-520e743519c0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118970 Apr 07 17:11:39.546252 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Apr 7 17:11:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:11:41.933401 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-f33db1bb-b42a-4dcb-8fab-82f991cb1c0a admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:41.934418 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-f33db1bb-b42a-4dcb-8fab-82f991cb1c0a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Apr 07 17:11:41.934824 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:41.998201 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-2ee9a636-bcc0-4c80-9e45-8e966c6fe65b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024, "vcpus": 1, "swap": 0}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:42.073870 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-2ee9a636-bcc0-4c80-9e45-8e966c6fe65b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.132848 Apr 07 17:11:42.074641 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:11:42.087073 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-e2b68a49-4298-4e1a-92c6-3898eb4a34e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:42.196063 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-e2b68a49-4298-4e1a-92c6-3898eb4a34e0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112500 Apr 07 17:11:42.196974 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Apr 7 17:11:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:11:44.607980 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-2ee9a636-bcc0-4c80-9e45-8e966c6fe65b admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:44.609014 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-2ee9a636-bcc0-4c80-9e45-8e966c6fe65b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Apr 07 17:11:44.609452 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:44.670240 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-a188001b-c35a-4a86-a0cf-4173e7802d44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "ram": 2048, "vcpus": 2}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:44.769894 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-a188001b-c35a-4a86-a0cf-4173e7802d44 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154591 Apr 07 17:11:44.770466 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:11:44.783028 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-9ac45a70-b1ac-4ad2-9b81-96657e8d4830 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:44.866456 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-9ac45a70-b1ac-4ad2-9b81-96657e8d4830 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087081 Apr 07 17:11:44.867046 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Apr 7 17:11:44 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:11:47.225744 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-a188001b-c35a-4a86-a0cf-4173e7802d44 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:47.226757 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-a188001b-c35a-4a86-a0cf-4173e7802d44 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Apr 07 17:11:47.227157 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:47.289058 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-074a27e7-85b1-47ec-ba41-bc653bbf2f84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:47.394897 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-074a27e7-85b1-47ec-ba41-bc653bbf2f84 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161356 Apr 07 17:11:47.395487 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:11:47.407772 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-33616972-9631-46bc-b254-65cb40685541 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:47.489941 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-33616972-9631-46bc-b254-65cb40685541 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086170 Apr 07 17:11:47.490674 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Thu Apr 7 17:11:47 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:11:49.895337 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-074a27e7-85b1-47ec-ba41-bc653bbf2f84 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:49.896489 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-074a27e7-85b1-47ec-ba41-bc653bbf2f84 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Apr 07 17:11:49.896976 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:49.959478 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-e4071090-05e1-4372-850f-7c6f5ea4c92a admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:49.983379 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-e4071090-05e1-4372-850f-7c6f5ea4c92a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077309 Apr 07 17:11:49.984243 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Apr 7 17:11:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:11:52.724150 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-074a27e7-85b1-47ec-ba41-bc653bbf2f84 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:52.725202 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-074a27e7-85b1-47ec-ba41-bc653bbf2f84 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Apr 07 17:11:52.725621 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:52.795605 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-62934555-5fa3-4050-b251-5f21d4b01615 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "ram": 512, "vcpus": 1, "swap": 0, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:52.907349 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-62934555-5fa3-4050-b251-5f21d4b01615 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.175268 Apr 07 17:11:52.907820 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:52 2022] POST /compute/v2.1/flavors => generated 402 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:11:52.919919 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-1fa8b90d-17bd-4f88-9879-6b9887345c2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:53.015481 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-1fa8b90d-17bd-4f88-9879-6b9887345c2e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099380 Apr 07 17:11:53.016088 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Apr 7 17:11:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:11:55.472678 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-62934555-5fa3-4050-b251-5f21d4b01615 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:55.473733 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-62934555-5fa3-4050-b251-5f21d4b01615 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Apr 07 17:11:55.474141 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:55.541364 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-13fbb1df-9192-4176-9f6e-62207ef4bf4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:55.617739 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-13fbb1df-9192-4176-9f6e-62207ef4bf4d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.137780 Apr 07 17:11:55.618420 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:11:55.630568 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-81442c18-8be9-4683-be8f-f91babe61791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:55.726928 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-81442c18-8be9-4683-be8f-f91babe61791 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100008 Apr 07 17:11:55.727515 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Apr 7 17:11:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:11:58.099820 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-13fbb1df-9192-4176-9f6e-62207ef4bf4d admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:11:58.100839 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-13fbb1df-9192-4176-9f6e-62207ef4bf4d admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Apr 07 17:11:58.101285 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:11:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:11:58.161060 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-1313894b-6abd-43e9-890c-d5cc9d711aa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "disk": 40, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:58.251131 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-1313894b-6abd-43e9-890c-d5cc9d711aa2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.143853 Apr 07 17:11:58.251676 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:11:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:11:58.263665 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-1c857481-4d80-4358-ac95-8ee8cae8442b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:11:58.352357 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-1c857481-4d80-4358-ac95-8ee8cae8442b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092306 Apr 07 17:11:58.352885 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Apr 7 17:11:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:12:00.738195 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-1313894b-6abd-43e9-890c-d5cc9d711aa2 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:00.741679 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-1313894b-6abd-43e9-890c-d5cc9d711aa2 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001990 Apr 07 17:12:00.741679 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:12:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:00.810966 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-5ef0b6cb-7f45-4085-a201-b47b3c91b0a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "id": "4", "swap": 0}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:00.902651 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-5ef0b6cb-7f45-4085-a201-b47b3c91b0a5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.156455 Apr 07 17:12:00.905649 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:12:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:12:00.918960 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-627159ad-0930-4348-b0cd-f7b5341e2d69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:01.003493 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-627159ad-0930-4348-b0cd-f7b5341e2d69 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089989 Apr 07 17:12:01.004090 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Apr 7 17:12:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:12:03.529794 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-5ef0b6cb-7f45-4085-a201-b47b3c91b0a5 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:03.531452 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-5ef0b6cb-7f45-4085-a201-b47b3c91b0a5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 Apr 07 17:12:03.531856 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:12:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:03.594296 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-9d6168f8-8117-49c7-80ff-d06e92768bf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "disk": 160, "swap": 0}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:03.673978 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-9d6168f8-8117-49c7-80ff-d06e92768bf0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.136207 Apr 07 17:12:03.675113 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Thu Apr 7 17:12:03 2022] POST /compute/v2.1/flavors => generated 408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 17:12:03.687806 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-02259ab5-e6ba-4101-ae71-9dc4625b3919 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:03.781078 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-02259ab5-e6ba-4101-ae71-9dc4625b3919 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098065 Apr 07 17:12:03.781728 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Thu Apr 7 17:12:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:12:27.318420 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-9d6168f8-8117-49c7-80ff-d06e92768bf0 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:27.319418 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-9d6168f8-8117-49c7-80ff-d06e92768bf0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Apr 07 17:12:27.319812 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:12:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:27.376418 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-2f90d8ef-6323-48a0-8022-96425c66350f admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:27.393033 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-2f90d8ef-6323-48a0-8022-96425c66350f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066945 Apr 07 17:12:27.393609 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Apr 7 17:12:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:12:28.802474 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-9d6168f8-8117-49c7-80ff-d06e92768bf0 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:28.809110 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-9d6168f8-8117-49c7-80ff-d06e92768bf0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Apr 07 17:12:28.809110 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:28.999421 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-3d380919-0d1c-45fc-ba89-014eba26d840 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:29.004839 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.wsgi [None req-3d380919-0d1c-45fc-ba89-014eba26d840 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 07 17:12:29.005434 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-3d380919-0d1c-45fc-ba89-014eba26d840 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:12:29.006228 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-3d380919-0d1c-45fc-ba89-014eba26d840 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059224 Apr 07 17:12:29.006746 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Apr 7 17:12:28 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 17:12:29.016843 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-2c93f2a2-6051-42c1-8789-e7e4c5c611a1 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:29.037180 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-2c93f2a2-6051-42c1-8789-e7e4c5c611a1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024006 Apr 07 17:12:29.037722 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Apr 7 17:12:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:12:29.047396 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-3c7ec46a-eafd-4324-9739-ec4c4da2f494 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:29.068492 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-3c7ec46a-eafd-4324-9739-ec4c4da2f494 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024645 Apr 07 17:12:29.069040 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Apr 7 17:12:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:12:29.078830 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-3eb00c64-4ee9-4150-9ee5-d0505acd381f admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:29.084229 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.wsgi [None req-3eb00c64-4ee9-4150-9ee5-d0505acd381f admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 07 17:12:29.084796 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-3eb00c64-4ee9-4150-9ee5-d0505acd381f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:12:29.085629 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-3eb00c64-4ee9-4150-9ee5-d0505acd381f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010396 Apr 07 17:12:29.086128 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Apr 7 17:12:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 17:12:30.362566 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-3c7ec46a-eafd-4324-9739-ec4c4da2f494 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:30.363573 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-3c7ec46a-eafd-4324-9739-ec4c4da2f494 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Apr 07 17:12:30.364013 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:30.553541 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-138cd14e-026f-4f04-9bdd-2774c49ff92b admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:30.559222 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.wsgi [None req-138cd14e-026f-4f04-9bdd-2774c49ff92b admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 07 17:12:30.559768 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-138cd14e-026f-4f04-9bdd-2774c49ff92b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:12:30.560544 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-138cd14e-026f-4f04-9bdd-2774c49ff92b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058521 Apr 07 17:12:30.561046 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Apr 7 17:12:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 17:12:30.570296 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-185f2d25-1ee4-4898-8a14-86bf7927c973 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:30.584261 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-185f2d25-1ee4-4898-8a14-86bf7927c973 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017524 Apr 07 17:12:30.584718 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Apr 7 17:12:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:12:30.593749 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-24375e45-649e-4272-b706-78835ee72757 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:30.607090 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-24375e45-649e-4272-b706-78835ee72757 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016782 Apr 07 17:12:30.607628 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Apr 7 17:12:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:12:30.616681 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0545782e-d325-48e1-9ebc-44900763abd1 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:30.622485 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.wsgi [None req-0545782e-d325-48e1-9ebc-44900763abd1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 07 17:12:30.623112 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0545782e-d325-48e1-9ebc-44900763abd1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:12:30.623901 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0545782e-d325-48e1-9ebc-44900763abd1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010747 Apr 07 17:12:30.624401 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Thu Apr 7 17:12:30 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 07 17:12:31.902294 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-24375e45-649e-4272-b706-78835ee72757 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:31.903341 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-24375e45-649e-4272-b706-78835ee72757 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Apr 07 17:12:31.903684 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:32.093458 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-47536a60-fcae-4138-8ad5-489465836eef admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:32.098680 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.wsgi [None req-47536a60-fcae-4138-8ad5-489465836eef admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 07 17:12:32.099241 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-47536a60-fcae-4138-8ad5-489465836eef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:12:32.100027 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-47536a60-fcae-4138-8ad5-489465836eef admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058960 Apr 07 17:12:32.100547 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Apr 7 17:12:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 17:12:32.109800 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-40fc2b61-4431-4ccf-8ae8-a8b7135f1747 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:32.123616 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-40fc2b61-4431-4ccf-8ae8-a8b7135f1747 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017383 Apr 07 17:12:32.124129 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Apr 7 17:12:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:12:32.133672 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:32.147286 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017508 Apr 07 17:12:32.147816 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Thu Apr 7 17:12:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:12:32.157436 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-9641e1b8-6ad1-4cc9-9381-74107d1c5e81 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:32.162405 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.wsgi [None req-9641e1b8-6ad1-4cc9-9381-74107d1c5e81 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 07 17:12:32.162950 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-9641e1b8-6ad1-4cc9-9381-74107d1c5e81 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:12:32.163715 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-9641e1b8-6ad1-4cc9-9381-74107d1c5e81 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010028 Apr 07 17:12:32.164197 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Apr 7 17:12:32 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 07 17:12:33.449354 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:33.450898 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002530 Apr 07 17:12:33.451297 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:33.640269 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-17d0eb73-1437-496f-ac2e-a1a01304540d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:33.712348 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-17d0eb73-1437-496f-ac2e-a1a01304540d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.123631 Apr 07 17:12:33.712890 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Apr 7 17:12:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:12:34.999918 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:35.000930 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Apr 07 17:12:35.001395 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:35.190723 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-6bb76217-b240-41d4-af55-dcfb12edaa6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:35.263859 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-6bb76217-b240-41d4-af55-dcfb12edaa6b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124553 Apr 07 17:12:35.264328 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Apr 7 17:12:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:12:36.552324 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:36.553405 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Apr 07 17:12:36.553811 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:36.743215 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-e6d597d6-b170-44ec-b29d-57e1b7c9a3b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:36.826729 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-e6d597d6-b170-44ec-b29d-57e1b7c9a3b3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.133508 Apr 07 17:12:36.827194 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Apr 7 17:12:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:12:38.095550 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:38.096626 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Apr 07 17:12:38.097029 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:38.290275 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-6942d06c-01f5-4391-979e-f5d0b79145f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:12:38.362237 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-6942d06c-01f5-4391-979e-f5d0b79145f4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.124058 Apr 07 17:12:38.362700 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Thu Apr 7 17:12:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:12:39.638724 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:39.639813 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Apr 07 17:12:39.640327 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:12:39.830581 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-412505fa-dcc7-4c99-ae57-4b2bc839ce1d admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:12:39.847726 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-412505fa-dcc7-4c99-ae57-4b2bc839ce1d admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069102 Apr 07 17:12:39.848199 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Thu Apr 7 17:12:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:13:43.687529 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:13:43.688567 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-86b2685b-62a5-4e75-8f85-cc77b554225e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Apr 07 17:13:43.688968 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Thu Apr 7 17:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:13:43.751907 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-a36bb854-85d2-49f1-835b-2fdd7206f6a7 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:13:43.770513 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-a36bb854-85d2-49f1-835b-2fdd7206f6a7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075300 Apr 07 17:13:43.771041 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Thu Apr 7 17:13:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:13:43.795989 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-5dde990b-5107-4537-aca8-d1ac8715b5f9 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:13:43.805250 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-5dde990b-5107-4537-aca8-d1ac8715b5f9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014559 Apr 07 17:13:43.805802 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Thu Apr 7 17:13:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:13:43.822966 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-1f7c0653-3ab2-4232-b90b-acef534f6294 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:13:43.830938 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-1f7c0653-3ab2-4232-b90b-acef534f6294 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012864 Apr 07 17:13:43.832138 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Thu Apr 7 17:13:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:13:43.843637 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-77a57fe9-cfe8-4c90-a9d6-45169d79f765 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:13:43.852656 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-77a57fe9-cfe8-4c90-a9d6-45169d79f765 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012619 Apr 07 17:13:43.853248 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Thu Apr 7 17:13:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:13:43.864998 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:13:43.873716 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012477 Apr 07 17:13:43.874198 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Thu Apr 7 17:13:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:16:02.712955 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-1ec0ad09-3baa-4f4a-bae9-c8b2d46dd2a4 tempest-verify_tempest_config-926479343 tempest-verify_tempest_config-926479343-project] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:16:02.714959 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-1ec0ad09-3baa-4f4a-bae9-c8b2d46dd2a4 tempest-verify_tempest_config-926479343 tempest-verify_tempest_config-926479343-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107084 Apr 07 17:16:02.715494 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1133 bytes} [Thu Apr 7 17:16:02 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:17:43.676266 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:43.677388 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Apr 07 17:17:43.677845 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 36/70] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:17:43.938487 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-de6f0096-3a66-4c65-ac7b-1285b1e65ce2 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:43.939669 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:17:43.939669 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Apr 07 17:17:43.940950 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de6f0096-3a66-4c65-ac7b-1285b1e65ce2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:43.941538 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de6f0096-3a66-4c65-ac7b-1285b1e65ce2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:43.942313 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de6f0096-3a66-4c65-ac7b-1285b1e65ce2 admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:43.942735 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de6f0096-3a66-4c65-ac7b-1285b1e65ce2 admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:43.977376 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-de6f0096-3a66-4c65-ac7b-1285b1e65ce2 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.158633 Apr 07 17:17:43.979427 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 35/71] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Apr 7 17:17:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:17:45.270938 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:45.271926 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Apr 07 17:17:45.272322 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:17:45.465430 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-446874cf-5a77-462f-8f9d-292752e84eac admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:45.466635 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:17:45.466635 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Apr 07 17:17:45.467805 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-446874cf-5a77-462f-8f9d-292752e84eac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:45.468243 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-446874cf-5a77-462f-8f9d-292752e84eac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:45.469225 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-446874cf-5a77-462f-8f9d-292752e84eac admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:45.469653 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-446874cf-5a77-462f-8f9d-292752e84eac admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:45.488889 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-446874cf-5a77-462f-8f9d-292752e84eac admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075122 Apr 07 17:17:45.489404 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 36/73] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Apr 7 17:17:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:17:57.208893 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:57.209915 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Apr 07 17:17:57.210306 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 38/74] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:17:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:17:57.405227 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-de0e2a73-4736-44e2-a5a1-a4b66ce9c64d admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:57.406431 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:17:57.406431 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Apr 07 17:17:57.408238 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de0e2a73-4736-44e2-a5a1-a4b66ce9c64d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:57.408679 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de0e2a73-4736-44e2-a5a1-a4b66ce9c64d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:57.409506 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de0e2a73-4736-44e2-a5a1-a4b66ce9c64d admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:57.409983 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-de0e2a73-4736-44e2-a5a1-a4b66ce9c64d admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:57.434130 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-de0e2a73-4736-44e2-a5a1-a4b66ce9c64d admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078727 Apr 07 17:17:57.434622 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 37/75] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Apr 7 17:17:57 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:17:58.734252 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: DEBUG nova.api.openstack.wsgi [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] Calling method '>' {{(pid=103277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:58.735918 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: INFO nova.api.openstack.requestlog [None req-b73671f3-a98e-43e2-9b5b-9df071f0fc22 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Apr 07 17:17:58.736319 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: [pid: 103277|app: 0|req: 39/76] 10.222.0.26 () {56 vars in 1074 bytes} [Thu Apr 7 17:17:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:17:58.926212 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-8eb6eed4-e8d8-49f9-91aa-5c806e0f7376 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:17:58.927413 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 07 17:17:58.927413 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Apr 07 17:17:58.928660 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-8eb6eed4-e8d8-49f9-91aa-5c806e0f7376 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:58.929103 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-8eb6eed4-e8d8-49f9-91aa-5c806e0f7376 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:58.929943 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-8eb6eed4-e8d8-49f9-91aa-5c806e0f7376 admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:17:58.930369 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-8eb6eed4-e8d8-49f9-91aa-5c806e0f7376 admin admin] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:17:58.958066 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-8eb6eed4-e8d8-49f9-91aa-5c806e0f7376 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083561 Apr 07 17:17:58.958699 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 38/77] 10.222.0.26 () {60 vars in 1193 bytes} [Thu Apr 7 17:17:58 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:18:56.896467 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: Thu Apr 7 17:18:56 2022 - graceful shutdown triggered... Apr 07 17:18:56.896998 dv-cinder-836996-1-iscsi devstack@n-api.service[103276]: Gracefully killing worker 1 (pid: 103276)... Apr 07 17:18:56.897506 dv-cinder-836996-1-iscsi devstack@n-api.service[103277]: Gracefully killing worker 2 (pid: 103277)... Apr 07 17:18:56.898713 dv-cinder-836996-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 07 17:18:57.897324 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: worker 1 buried after 1 seconds Apr 07 17:18:57.897324 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: worker 2 buried after 1 seconds Apr 07 17:18:57.897324 dv-cinder-836996-1-iscsi devstack@n-api.service[103275]: goodbye to uWSGI. Apr 07 17:18:57.898874 dv-cinder-836996-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 07 17:18:57.899444 dv-cinder-836996-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 07 17:18:57.902432 dv-cinder-836996-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 07 17:18:57.915772 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Apr 7 17:18:57 2022] *** Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: nodename: dv-cinder-836996-1-iscsi Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: machine: x86_64 Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: clock source: unix Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: pcre jit disabled Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: detected number of CPU cores: 4 Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: current working directory: / Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: detected binary path: /usr/bin/uwsgi-core Apr 07 17:18:57.930274 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: your processes number limit is 47680 Apr 07 17:18:57.931180 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: your memory page size is 4096 bytes Apr 07 17:18:57.931180 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: detected max file descriptor number: 2048 Apr 07 17:18:57.931180 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: lock engine: pthread robust mutexes Apr 07 17:18:57.931180 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: thunder lock: enabled Apr 07 17:18:57.931180 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 07 17:18:57.931180 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 07 17:18:57.976968 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: Python main interpreter initialized at 0x5555c3d049c0 Apr 07 17:18:57.976968 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: python threads support enabled Apr 07 17:18:57.976968 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: your server socket listen backlog is limited to 100 connections Apr 07 17:18:57.976968 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: your mercy for graceful operations on workers is 90 seconds Apr 07 17:18:57.977420 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: mapped 403077 bytes (393 KB) for 2 cores Apr 07 17:18:57.977420 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: *** Operational MODE: preforking *** Apr 07 17:18:57.977684 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: *** uWSGI is running in multiple interpreter mode *** Apr 07 17:18:57.977684 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: spawned uWSGI master process (pid: 117687) Apr 07 17:18:57.977881 dv-cinder-836996-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 07 17:18:57.978570 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: spawned uWSGI worker 1 (pid: 117702, cores: 1) Apr 07 17:18:57.981166 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: spawned uWSGI worker 2 (pid: 117703, cores: 1) Apr 07 17:18:57.981166 dv-cinder-836996-1-iscsi devstack@n-api.service[117687]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 07 17:18:59.206352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 17:18:59.242106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 07 17:19:00.147758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:19:00.147758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: from cryptography.utils import int_from_bytes Apr 07 17:19:00.148081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:19:00.148081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: from cryptography.utils import int_from_bytes Apr 07 17:19:00.190894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:19:00.190894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: from cryptography.utils import int_from_bytes Apr 07 17:19:00.191229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 07 17:19:00.191229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: from cryptography.utils import int_from_bytes Apr 07 17:19:02.579579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 17:19:02.580150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 17:19:02.580363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 17:19:02.580737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 17:19:02.581004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 17:19:02.581463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.581801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.582133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.582461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.582801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.583119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.583450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.583782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.584116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.584385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.584708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.585043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-1-iscsi {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.585399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.585716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.586036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.586363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.586677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.587009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.587324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.587832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.589012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.589012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.589012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.589437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.589587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.589906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.590237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.590554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.590881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.591977 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.592947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-1-iscsi {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.592947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.593287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.593606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.594085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.594420 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.594783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.595086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.595429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.595754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.596098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.596435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.596769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.597103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.597459 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.597880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.598207 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.598544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.598861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.599181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.599445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.599766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.600101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.600434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.600770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.601034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.601322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.601656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.601989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.602310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.602629 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.602946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.603261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.603580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.603904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.604221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.604538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.604868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.605224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.605557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.605877 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.606209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.606620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.606878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.607195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.607545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.607873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.608192 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.608530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.608855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.609190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.610059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.610557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.610900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.611262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.611572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.611833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.612147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.612463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.612794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.613113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.613465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.613780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.614096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.614415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.614734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.615048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.615365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.615677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.615991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.616305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.616622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.616935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.617287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.617621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.617938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.618256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.618584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.618890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.619220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.619537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.619853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.620184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.620500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.620815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.621176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.621486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.621800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.622127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.622439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.622755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.623083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.623397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.623711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.624024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.624345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.624663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.624974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.626501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.626501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.626501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.628611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.628611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.628611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.628611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.628611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.628611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.629333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.629333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.629522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.629719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.630060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.630400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.630726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.631047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.631370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.631709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.632027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.632347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.632668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.632996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.633350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.633691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.634015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.634346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.634675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.634991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.635316 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.635655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.636051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.636302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.636651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.637002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.637348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.637683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.638012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.638332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.638651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.638969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.639298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.639635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.639954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.640281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.640600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.641020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.641368 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.641692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.642010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.642354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.642928 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.643253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.643574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.643899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.644219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.644542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.644859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.645190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.645507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.645819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.646133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.646444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.646770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.647111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.650557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.652123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.653089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.653089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.653089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.653495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.654153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.654153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.654330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.654508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.654849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.655187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.655500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.655836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.656171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.656565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.656836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.657156 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.657470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.657779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.658090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.658405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.658715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.659026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.659338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.659646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.659748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 07 17:19:02.660121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.660221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 07 17:19:02.660316 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.660465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 07 17:19:02.660559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.660831 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 07 17:19:02.660933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.661090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 07 17:19:02.661235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.661485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.661577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.661827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.661931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.662156 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.662292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.662461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.662562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.662791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.662892 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.663102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.663203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.663425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.663529 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.663746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.663840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.664068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.664165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.664328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.664498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.664646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.664740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.664972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836996-1-iscsi {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.665065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.665864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.665974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.666083 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.666179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.666273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.666365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.666502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.666599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.666695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.666793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.666887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.666973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.667159 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.667272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.667503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.667657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.667815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.667971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.668136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.668322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.668483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.668576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.668823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.668916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.669199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.669758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.669902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.670038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.670161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.670274 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.670394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.670516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.670636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.670760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.670873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.670983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.671108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.671221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836996-1-iscsi {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.671332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.671508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.671677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.671813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.671945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.672909 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.673046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.673182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.673440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.673578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.673760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.673907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.674093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.674233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.674400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.674583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.674729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.674869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.675076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.675217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.675389 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.675537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.675707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.675918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.676102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.676235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.676368 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.676508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.676639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.676777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.676914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.677045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.677252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.677407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.677552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.677681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.677868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.677975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.678173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.678274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.678427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.678521 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.678736 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.678906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.679061 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.679203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.679387 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.679570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.679704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.679825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.679972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.680071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.680197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.680343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.680520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.680731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.680871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.681008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.681178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.681327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.681469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.681624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.681839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.682043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.682148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.682236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.682330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.682500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.682633 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.682813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.682943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.683144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.683246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.683462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.683555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.683776 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.683878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.684090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.684244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.684403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.684508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.684756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.684906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.685077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.685209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.685417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.685518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.685730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.685869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.686055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.686159 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.686375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.686515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.686682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.686790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.686997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.687091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.687314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.687414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.687700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.688431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.688577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.688978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.689074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.689326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.689434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.689659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.689765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.689978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.690079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.690302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.690427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.690541 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.690640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.690849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.690962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.691158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.691260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.691481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.691594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.691791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.691899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.692103 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.692211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.692411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.692519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.692715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.693025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.693125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.693358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.693473 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.693666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.693773 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.693974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.694081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.694283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.694398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.694588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.694681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.694896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.695010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.695204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.695325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.695512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.695624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.695847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.696003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.696156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.696256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.696464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.696556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.696772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.696872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.697080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.697196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.697435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.697536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.697759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.697871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.698068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.698167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.698376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.698467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.698708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.698809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.699002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.699107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.699310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.699401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.699640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.699729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.699941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.700041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.700252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.700348 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.700570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.700669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.700873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.700973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.701200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.701295 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.701521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.701622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.701831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.701927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.702137 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.702226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.702441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.702550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.702747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.702844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.703052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.703142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.703584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.703840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.703960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.704179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.704274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.704498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.704597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.704810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.704910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.705147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.705251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.705470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.705589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.705787 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.705897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.706097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.706189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.706410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.706554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.706725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.706824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 07 17:19:02.707035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.707126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.707354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.707455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.707671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.707762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.707987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.708088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.708303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.708406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.708614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.708706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.708929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.709034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.709261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.709370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.709586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.709678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.709903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.709994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.710214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.710314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.710526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711539 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.711846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.712056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.712149 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.712374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.712464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.712685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.712788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.712996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.713093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.713331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.713425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.713649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.713832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.713967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.714066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.714276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.714408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.714605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.714710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.714926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.715025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.715238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.715337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.715546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.715647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.715865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.716002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.716177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.716286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.716486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.716598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.716798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.716901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.717121 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.717248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.717468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.717581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.717778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.717872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.718095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.718200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.718405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.718513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.718716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.718809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.719105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.719194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.719372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.719548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.719730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.719904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.720030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.720275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.720378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.720585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.720713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.720896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.720996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.721249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.721345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.721567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.721658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.721881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.721974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.722193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.722292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.722502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.722594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.722853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.722944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.723165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.723258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.723498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.723588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.723823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.723934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.724142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.724234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.724463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.724551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.724780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.724879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.725104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.725234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.725448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.725542 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.725758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.725862 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.726081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.726208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.726395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.726489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.726712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.726811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.727022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.727113 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.727334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.727425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.727651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.727749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.727966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.728055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.728284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.728429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.728600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.728691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.728914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.729006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.729275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.729385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.729595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.729710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.729907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.730037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.730225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.730341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.730538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.730642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.730857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.730963 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.731170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.731271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.731487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.731582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.731809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.731903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.732125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.732229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.732443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.732543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.732762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.732854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.733075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.733230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.733419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.733513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.733736 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.733828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.734050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.734163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.734382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.735034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.735192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.735323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.735526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.735648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.735908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.736003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.736223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.736330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.736539 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.736653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.736857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.736951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.737187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.737371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.737537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.737637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.737805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.737950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.738118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.738268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.738463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.738614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.738764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.738907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.739054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.739208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.739348 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.739508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.739644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.739819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.739994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.740244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.740407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.740564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.740712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.740851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.740998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.741196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.741351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.741498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.741644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.741808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.741949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.742125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.742261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.742456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.742593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.742767 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.742914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.743082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.743218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.743392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.743527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.743720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.743864 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.744030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.744171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.744351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.744492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.744676 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.744819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.744995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.745190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.745350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.745456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.745673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.745858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.746019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.746160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.746316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.746468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.746696 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.746855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.747000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.747142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.747282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.747424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.747573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.747715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.747887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.748024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.748207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.748374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.748527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.748619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.748831 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.748940 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.749170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.749341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.749494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.749644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.749785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.749920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.750133 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.750910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.751063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.751210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.751362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.751478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.751692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.751872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.752059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.752152 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.752379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.752472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.752706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.752807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.753022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.753193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.753385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.753539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.753718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.753866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.754033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.754170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.754355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.754498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.754670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.754821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.754984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.755126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.755286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.755445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.755608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.755774 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.755913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.756185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.756341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.756475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.756623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.756788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.756921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.757055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.757227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.757327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.757454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.757555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.757770 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.757861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.758079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.758170 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.758400 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.758513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.758720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.758823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.759034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.759135 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.759344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.759442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.759660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.759757 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.759977 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.760074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.760290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.760380 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.760601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.760718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.760930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.761054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.761269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.761363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.761585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.761677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.761912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.762015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.762227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.762320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.762540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.762668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.762854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.762974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.763166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.763265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.763516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.763614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.763832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.763932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.764145 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.764246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.764466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.764565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.764792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.764891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.765102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.765214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.765445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.765544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.765761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.766077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.766406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.766724 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.766829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.767039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.767134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.767357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.767447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.767925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.768024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.768246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.768347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.768561 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.768653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.768887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.768996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.769225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.769334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.769545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.769636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.769863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.769953 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.770173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.770320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.770487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.770578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.770804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.770912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.771122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.771385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.771478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.771726 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.771817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.772050 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.772149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.772375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.772474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.772702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.772794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.773029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.773128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.773405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.773496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.773739 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.773836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.774065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.774165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.774392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.774497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.774710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.774810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.775024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.775124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.775335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.775436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.775652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.775754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.775964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.776063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.776273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.776437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.776584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.776685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.776899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.777026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.777231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.777351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.777543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.777779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.777878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.778117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.778282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.778439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.778532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.778755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.778912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.779098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.779232 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.779374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.779474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.779695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.779786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.780008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.780108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.780317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.780408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.780661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.780760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.780925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.781013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.781290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.781462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.781602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.781700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.781945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.782052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.782281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.782373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.782609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.782699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.782927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.783019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.783240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.783330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.783559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.783658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.783868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.783958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.784178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.784268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.784486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.784587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.784799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.784890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.785111 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.785267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.785442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.785551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.785758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.785857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.786074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.786176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.786389 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.786530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.786704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.786795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.787012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.787139 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.787325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.787425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.787634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.787735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.787953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.788045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.788266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.788356 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.788573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.788672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.788882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.788974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.789222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.789332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.789538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.789638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.789849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.789950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.790166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.790396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.790527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.790722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.790826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.791064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.791155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.791374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.791506 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.791683 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.791786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.791997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.792103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.792311 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.792411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.792619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.792711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.792947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.793037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.793283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.793379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.793594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.793694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.793901 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.794002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.794213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.794303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.794519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.794611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.794827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.794926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.795139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.795244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.795463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.795553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.795780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.795871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.796084 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.796334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.796434 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.796693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.796782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.797510 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.797649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.797828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.798129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.798222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.798527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.798636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.798863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.799003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.799185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.799336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.799522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.799656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.799844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.799937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.800162 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.800253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.800489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.800579 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.800812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.800912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.801130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.801252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.801469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.801561 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.801794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.801897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.802112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.802210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.802428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.802533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.802749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.802849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.803063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.803155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.803385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.803561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.803703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.803803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.804014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.804105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.804328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.804433 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.804633 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.804731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.804953 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.805044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.805286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.805393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.805608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.805707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.805921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.806039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.806223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.806329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.806536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.806660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809277 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809728 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.809973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.810983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.811921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.812020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.812107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.812200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.812287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.812416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.812535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.813355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.813470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.813704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.813846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.814046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.814175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.814362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.814491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.814687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.814809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.815004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.815109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.815328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.815429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.815648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.815750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.815969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.816134 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.816288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.816451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.816607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.816769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.816932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.817088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.817276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.817413 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.817595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.817730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.817912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.818086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.818235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.818368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.818556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.818664 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.818873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.819089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.819199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.819409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.819512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.819729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.819842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.820047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.820151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.820358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.820469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.820668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.820780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.820983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.821087 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.821340 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.821444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.821678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.821797 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.821961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.822073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.822269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.822364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.822599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.822720 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.822912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.823015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.823238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.823333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.823563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.823657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.823975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.824077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.824290 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.824398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.824614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.824706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.824941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.825035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.825284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.825412 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.825614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.825716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.825948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.826050 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.826270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.826388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.826595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.826709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.826915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.827022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.827233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.827346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.827561 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.827666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.827893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.827996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.828217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.828342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.828548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.828708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.828962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.829057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.829318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.829422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.829639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.829733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.829966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.830068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.830284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.830380 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.830596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.830725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.830908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.831057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.831225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.831376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.831539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.831780 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.831886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.832039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.832134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.832351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.832451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.832676 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.832782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.832979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.833082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.833312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.833409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.833627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.833730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.833955 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.834056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.834264 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.834365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.834573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.834674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.834887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.834980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.835196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.835297 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.835503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.835605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.835818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.835990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.836146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.836259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.836453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.836692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.836786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.837093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.837446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.837716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.837837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.838066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.838165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.838392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.838497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.838707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.838819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.839017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.839122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.839333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.839437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.839638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.839744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.839988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.840086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.840301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.840406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.840628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.840735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.840946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.841049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.841331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.841436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.841699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.841825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.842099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.842236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.842318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.842398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.842827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.842947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.843035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.843157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.843272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.843391 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.843662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.843938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.844095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.844295 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.844452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.844638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.844846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.844998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.845172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.845322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.845416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.845640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.845744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.845951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.846054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.846265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.846367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.846577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.846682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.846911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.847019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.847221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.847314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.847547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.847645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.847860 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.847965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.848172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.848268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.848485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.848581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.848796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.848897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.849130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.849276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.849475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.849575 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.849813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.849912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.850134 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.850236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.850467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.850561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.850804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.850925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.851121 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.851239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.851452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.851548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.851779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.851879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.852103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.852215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.852419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.852522 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.852671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117703) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 17:19:02.852829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.853053 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.853403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.853729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.855472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.855472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.855472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.855472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.855817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.856017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.856343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.856665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.856987 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.857332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.857656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.857974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.858292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.858610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.858927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.859265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.860141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.860620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.860968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.861317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.861645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.861966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.862289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.862655 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.862978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.863294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.863615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.863936 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.864255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.864577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.864891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.865243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.866252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.866252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.866252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.866618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.866911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.867246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.867592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.867919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.868238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.868560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.869023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.869455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.871209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.871209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.871209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.871209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.871209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.871897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.871897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.872097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.872407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.872724 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.873043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.873613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.873951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.874272 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.874588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.874971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.875866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.876411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.876773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.877103 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.877578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.877922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.878266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.878569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.878920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.879247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.879538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.879866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.880189 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.880501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.880816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.881065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:02.881211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.881465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.881776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.882094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.882407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.882741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.883058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.883466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.883675 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.883993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.884303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.884619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.884930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.885261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.885584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.889665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.890745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.891145 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.891635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.891976 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.892304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.892905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.893279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.893600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.893911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.894225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.894649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.894972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.895287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.895603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.895920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.896238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.896555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.896869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.897304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.897603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.897852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.898170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.898482 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.898803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.899151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.899476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.899801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.900129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.900449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.900765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.901169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.901521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.901839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.902163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.902497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.902815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.903126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.903559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.903876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.904201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.904538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.904845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.905191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.905524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.905927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.906253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.907095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.907429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.907776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.908165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.908439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.908751 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.909064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.909401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.909716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.910040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.910356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.910663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.910975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.911287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.911595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.911904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.912211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.912651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.912973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.913302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.913618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.913931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.914238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.914546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.914890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.915168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.915477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.915789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.916101 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.916409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.916715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.917055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.917500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.917825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.918156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.918551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.918802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.919140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.919439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.919769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.920092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.920409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.920748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.921064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.921409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.921726 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.922737 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.923004 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.923324 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.923661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.924030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.924310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.924644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.924969 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.925325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.925647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.925966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.926298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.926617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.926937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.927281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.927571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.927888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.928207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.928576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.928889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.929244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.929578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.929912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.930263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.930581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.930941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.931275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.931596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.931915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.932225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 07 17:19:02.932473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117702) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 07 17:19:02.948564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.context [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8571387-67cb-4f0b-96d4-8f5caf004dc2(cell1) {{(pid=117703) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 17:19:02.954297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:02.954946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:02.955606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_db.sqlalchemy.engines [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:02.955927 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:02.957788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:02.971024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:02.971899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:03.022052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.context [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b8571387-67cb-4f0b-96d4-8f5caf004dc2(cell1) {{(pid=117702) load_cells /opt/stack/nova/nova/context.py:464}} Apr 07 17:19:03.025219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:03.026793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:03.027610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:03.029570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:03.040820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_db.sqlalchemy.engines [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:03.044093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_db.sqlalchemy.engines [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:03.135574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_db.sqlalchemy.engines [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117703) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:03.207898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_db.sqlalchemy.engines [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117702) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 07 17:19:03.584035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: WARNING keystonemiddleware.auth_token [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:19:03.590541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: WARNING keystonemiddleware.auth_token [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:19:03.650976 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: WARNING keystonemiddleware.auth_token [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:19:03.658416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: WARNING keystonemiddleware.auth_token [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:19:03.820914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: WARNING keystonemiddleware.auth_token [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:19:03.826102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: WARNING keystonemiddleware.auth_token [None req-c2b46bf6-1321-4508-a83c-d4b63def0cc6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:19:03.831479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555c3d049c0 pid: 117703 (default app) Apr 07 17:19:03.886192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: WARNING keystonemiddleware.auth_token [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 07 17:19:03.891441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: WARNING keystonemiddleware.auth_token [None req-7a52949f-9e92-4161-b560-cec012694a29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 07 17:19:03.897069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5555c3d049c0 pid: 117702 (default app) Apr 07 17:19:47.932338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9a861704-8a22-4948-9b13-6006b0a267ff tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] Action: 'create', calling method: .version_select at 0x7ff9d22be820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1653208415", "metadata": {"Type": "work"}}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:19:48.415799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1192250087", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "networks": [{"uuid": "c4ef013f-ac0e-46f4-9edf-ec3e00f4ca67"}]}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:19:49.029739 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] validate_networks() for [('c4ef013f-ac0e-46f4-9edf-ec3e00f4ca67', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:19:50.178097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9a861704-8a22-4948-9b13-6006b0a267ff tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.567567 Apr 07 17:19:50.178822 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Apr 7 17:19:46 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3570 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 07 17:19:50.198518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4fa69d23-8fb3-4ae1-b0ac-8cdecb84bbe3 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d2194820>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:50.384748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:19:50.385286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:19:50.388115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:19:50.388115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:19:50.388115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:19:50.443902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4fa69d23-8fb3-4ae1-b0ac-8cdecb84bbe3 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/accde36b-5c37-4f2e-9b5a-8c03e6de548e" status: 200 len: 351 microversion: 2.1 time: 0.256728 Apr 07 17:19:50.444720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:50.445034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 2/2] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:19:50 2022] GET /compute/v2.1/os-volumes/accde36b-5c37-4f2e-9b5a-8c03e6de548e => generated 351 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:19:50.447473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:50.448533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:50.449156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:50.450054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6177bb27-93ab-4afb-ac5c-ade7873f47e2 tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] Calling method '.version_select at 0x7ff9d21948b0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:50.499268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Getting quotas for project b00415c0a7d44437b37125395140181e. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:19:50.511822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Getting quotas for user 992930abf4a84c5fbff0b0dbe188d56c and project b00415c0a7d44437b37125395140181e. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:19:50.526476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:19:50.530284 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:19:50.735646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-61a43647-bcb6-4934-8f26-a3499d3900b5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.401788 Apr 07 17:19:50.738974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:19:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 3407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:19:50.751005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-75bdb483-3e9e-425a-ad36-b23b31369008 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:50.753669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-75bdb483-3e9e-425a-ad36-b23b31369008 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:51.164540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-75bdb483-3e9e-425a-ad36-b23b31369008 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:51.208051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-75bdb483-3e9e-425a-ad36-b23b31369008 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1215 microversion: 2.1 time: 0.463477 Apr 07 17:19:51.212124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:50 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1215 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:19:51.281334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6177bb27-93ab-4afb-ac5c-ade7873f47e2 tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56" status: 200 len: 354 microversion: 2.1 time: 0.833957 Apr 07 17:19:51.289844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:19:50 2022] GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56 => generated 354 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:19:51.301186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3ccb5a4a-8b3c-40bc-aa9c-538d47a4394b tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] Calling method '.version_select at 0x7ff9d21fa940>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:51.644127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3ccb5a4a-8b3c-40bc-aa9c-538d47a4394b tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56" status: 200 len: 354 microversion: 2.1 time: 0.350235 Apr 07 17:19:51.657547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 3/6] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:19:51 2022] GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56 => generated 354 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:19:51.666383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ca151dde-f308-48a6-9d2b-79ad69019e24 tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] Calling method '.version_select at 0x7ff9d21a3040>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:52.120620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ca151dde-f308-48a6-9d2b-79ad69019e24 tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56" status: 202 len: 0 microversion: 2.1 time: 0.413349 Apr 07 17:19:52.120620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:19:51 2022] DELETE /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 07 17:19:52.123887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ec7f1579-e17a-45e1-9ed8-3c4252796819 tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] Calling method '.version_select at 0x7ff9d1059550>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:52.230411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9fe7c4c2-57f7-4067-b770-336c454536df tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:52.231548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9fe7c4c2-57f7-4067-b770-336c454536df tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:52.244818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ec7f1579-e17a-45e1-9ed8-3c4252796819 tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56" status: 200 len: 353 microversion: 2.1 time: 0.153607 Apr 07 17:19:52.245634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:19:52 2022] GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:19:52.386829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9fe7c4c2-57f7-4067-b770-336c454536df tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:52.412050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9fe7c4c2-57f7-4067-b770-336c454536df tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1215 microversion: 2.1 time: 0.184996 Apr 07 17:19:52.424426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:52 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1215 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:19:53.258068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f061c93b-218a-4d1d-8ce8-11df7f8f699f tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] Calling method '.version_select at 0x7ff9d10598b0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:53.436986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-21646dd2-2da1-4faf-8f76-ee8da611bd2a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:53.440097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-21646dd2-2da1-4faf-8f76-ee8da611bd2a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:53.556458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-21646dd2-2da1-4faf-8f76-ee8da611bd2a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:53.578116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-21646dd2-2da1-4faf-8f76-ee8da611bd2a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1215 microversion: 2.1 time: 0.151811 Apr 07 17:19:53.591498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 6/10] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:53 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1215 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:19:53.733452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d5b85a81-061d-44de-aac4-900d9ba86511 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d20ea9d0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:53.824473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-f061c93b-218a-4d1d-8ce8-11df7f8f699f tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] HTTP exception thrown: Volume a5662db6-490e-41e3-878b-bf390d8b6f56 could not be found. Apr 07 17:19:53.825115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f061c93b-218a-4d1d-8ce8-11df7f8f699f tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] Returning 404 to user: Volume a5662db6-490e-41e3-878b-bf390d8b6f56 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:19:53.826062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f061c93b-218a-4d1d-8ce8-11df7f8f699f tempest-VolumesGetTestJSON-728468595 tempest-VolumesGetTestJSON-728468595-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56" status: 404 len: 109 microversion: 2.1 time: 0.572198 Apr 07 17:19:53.826801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 5/11] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:19:53 2022] GET /compute/v2.1/os-volumes/a5662db6-490e-41e3-878b-bf390d8b6f56 => generated 109 bytes in 574 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:19:54.053702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d5b85a81-061d-44de-aac4-900d9ba86511 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/107c2256-6772-46d5-adfe-6a597e735165" status: 200 len: 351 microversion: 2.1 time: 0.324868 Apr 07 17:19:54.060024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:19:53 2022] GET /compute/v2.1/os-volumes/107c2256-6772-46d5-adfe-6a597e735165 => generated 351 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:19:54.600115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:54.600760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:54.612805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:54.625031 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:54.626860 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:54.627321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:55.084479 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:55.105524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1883b1a1-5775-4098-afbf-55beaff2314b tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1211 microversion: 2.1 time: 0.510680 Apr 07 17:19:55.109221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 6/13] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:54 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1211 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:19:56.124981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:56.125729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:56.138754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:56.139819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:56.148941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:56.149619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:56.359632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:56.380625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-abf722fe-1dac-4968-aa1d-faf5ee717bba tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1211 microversion: 2.1 time: 0.259271 Apr 07 17:19:56.394328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 8/14] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:56 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1211 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:19:56.788970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-879021423", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:19:56.896503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] validate_networks() for [('a08d8121-3795-4290-8edc-155198c9e461', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:19:57.411604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:57.412235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:57.451315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:57.452945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:57.461414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:57.463834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:57.941213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:57.962651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ad8ec76d-e630-484f-a4cd-09a6c5a37b38 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1267 microversion: 2.1 time: 0.553670 Apr 07 17:19:57.974198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 9/15] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:57 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1267 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:19:58.191078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:19:58.191625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:19:58.192270 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:19:58.192830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:19:58.193553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:19:58.207884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:58.211020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:58.212313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:58.212951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:58.254538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:19:58.265398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for user 9717b85343d14a1c919091f29a591763 and project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:19:58.297811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:19:58.305242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:19:58.402598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-39dc68c8-0268-41ac-a043-50dc1268e978 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Action: 'create', calling method: .version_select at 0x7ff9d20a3040>, body: {"keypair": {"name": "tempest-keypair-1793611534"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:19:58.470396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-39dc68c8-0268-41ac-a043-50dc1268e978 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:19:58.479848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-39dc68c8-0268-41ac-a043-50dc1268e978 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for user 93ce92053f4a4fa1a639726b2685cec2 and project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:19:58.520034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d18718a9-5d80-46e9-8a27-630742108048 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.377590 Apr 07 17:19:58.524252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 7/16] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:19:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:19:58.535142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-551f327a-8d83-4c98-9d37-17d785c5d46a tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d0fe1d30>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:58.728360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-551f327a-8d83-4c98-9d37-17d785c5d46a tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2204b555-fbda-44d7-8804-d4e7a123f5d5" status: 200 len: 351 microversion: 2.1 time: 0.201791 Apr 07 17:19:58.729443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 8/17] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:19:58 2022] GET /compute/v2.1/os-volumes/2204b555-fbda-44d7-8804-d4e7a123f5d5 => generated 351 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:19:58.743362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f556319a-5b60-4190-80fc-61aa52c1e6db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:58.743362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f556319a-5b60-4190-80fc-61aa52c1e6db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:58.956142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f556319a-5b60-4190-80fc-61aa52c1e6db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:58.970073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f556319a-5b60-4190-80fc-61aa52c1e6db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1221 microversion: 2.1 time: 0.234873 Apr 07 17:19:58.971176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 9/18] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:58 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1221 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:19:58.983253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e6af6906-7d51-4d32-aa52-c12b85aa705c tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d0fe19d0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:59.264890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e6af6906-7d51-4d32-aa52-c12b85aa705c tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.292447 Apr 07 17:19:59.266376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 10/19] 10.222.0.26 () {58 vars in 1133 bytes} [Thu Apr 7 17:19:58 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:19:59.280889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:59.282513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:19:59.300528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:59.301228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:59.302420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:19:59.302997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:19:59.416607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-39dc68c8-0268-41ac-a043-50dc1268e978 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:19:59.439387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-39dc68c8-0268-41ac-a043-50dc1268e978 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for user 93ce92053f4a4fa1a639726b2685cec2 and project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:19:59.439574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:19:59.447267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8820c115-c982-4597-a8fd-271cb1371bad tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1273 microversion: 2.1 time: 0.179641 Apr 07 17:19:59.453342 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 11/20] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:19:59 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:19:59.464463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1129471237", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:19:59.477042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-39dc68c8-0268-41ac-a043-50dc1268e978 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.500124 Apr 07 17:19:59.493177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 10/21] 10.222.0.26 () {62 vars in 1198 bytes} [Thu Apr 7 17:19:57 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1508 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 07 17:19:59.494251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cf2545ca-6c97-4ccf-a8ec-4b5f51f505d9 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d17bc280>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:19:59.942951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cf2545ca-6c97-4ccf-a8ec-4b5f51f505d9 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.458292 Apr 07 17:19:59.943779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1148 bytes} [Thu Apr 7 17:19:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:19:59.956690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-04e32dd0-3005-45e6-9b4d-f6e6f0bc533d tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d17c10d0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:00.209215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-04e32dd0-3005-45e6-9b4d-f6e6f0bc533d tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.253827 Apr 07 17:20:00.210210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1133 bytes} [Thu Apr 7 17:19:59 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:00.222139 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2e53b7aa-5915-4e70-a6f3-318aabd0fceb tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d20a3dc0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:00.224804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] validate_networks() for [('a08d8121-3795-4290-8edc-155198c9e461', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:20:00.444791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2e53b7aa-5915-4e70-a6f3-318aabd0fceb tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.227458 Apr 07 17:20:00.446205 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1166 bytes} [Thu Apr 7 17:20:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:00.474730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f4720ebf-e795-4191-8001-bdb8ef72f431 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d17bc430>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:00.700812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f4720ebf-e795-4191-8001-bdb8ef72f431 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.245762 Apr 07 17:20:00.701534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 14/25] 10.222.0.26 () {58 vars in 1169 bytes} [Thu Apr 7 17:20:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:00.712870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:00.713902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:00.730711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:00.736430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:00.742372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:00.744540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:01.264705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:01.273303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1d5a874e-fc58-438a-8b96-e4b46aa759fe tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.570478 Apr 07 17:20:01.273762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 15/26] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:00 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:01.293738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-67dad3d2-ddca-463e-b467-6d29a7ba4e2e tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d17c1280>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:01.337248 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:20:01.338283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:20:01.338932 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:20:01.340905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:20:01.340905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:20:01.353810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:01.354531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:01.355922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:01.356743 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:01.402329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:20:01.408470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for user 9717b85343d14a1c919091f29a591763 and project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:20:01.425040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:20:01.428293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:20:01.511556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-67dad3d2-ddca-463e-b467-6d29a7ba4e2e tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.236740 Apr 07 17:20:01.515098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 16/27] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Apr 7 17:20:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:01.525234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7b8cb688-2c77-41e9-9af6-068e5a5adf94 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d17bc820>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:01.571049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-29fceab8-f820-4ff8-a0c6-a522a906510d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.114094 Apr 07 17:20:01.571049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 12/28] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:19:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:20:01.582395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fb78fc66-eefc-42e2-96d5-c62737338cff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:01.585119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fb78fc66-eefc-42e2-96d5-c62737338cff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:01.746472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fb78fc66-eefc-42e2-96d5-c62737338cff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:01.754502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7b8cb688-2c77-41e9-9af6-068e5a5adf94 tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.233740 Apr 07 17:20:01.755106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 17/29] 10.222.0.26 () {58 vars in 1187 bytes} [Thu Apr 7 17:20:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:20:01.759603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fb78fc66-eefc-42e2-96d5-c62737338cff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1222 microversion: 2.1 time: 0.183226 Apr 07 17:20:01.760202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 13/30] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:01 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1222 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:01.770071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-166e1539-632f-4738-905c-bfd5c2e3b27f tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] Calling method '.version_select at 0x7ff9d17dc700>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:02.020164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-166e1539-632f-4738-905c-bfd5c2e3b27f tempest-VolumesTestJSON-653525684 tempest-VolumesTestJSON-653525684-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.255173 Apr 07 17:20:02.020748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 18/31] 10.222.0.26 () {58 vars in 1154 bytes} [Thu Apr 7 17:20:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:02.290805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:02.291433 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:02.308856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:02.309602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:02.312318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:02.312318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:02.786668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8c739970-eb4f-4b3f-b207-e3e6f0319ca5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:02.804393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8c739970-eb4f-4b3f-b207-e3e6f0319ca5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:03.124389 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8c739970-eb4f-4b3f-b207-e3e6f0319ca5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:03.138511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8c739970-eb4f-4b3f-b207-e3e6f0319ca5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1222 microversion: 2.1 time: 0.356627 Apr 07 17:20:03.139759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 19/32] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:02 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1222 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:03.492996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:03.516868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-59b963e6-9f93-426e-b75c-5e13f41b7b20 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 1.224711 Apr 07 17:20:03.516868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 14/33] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:02 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:04.158932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:04.159561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:04.168075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:04.168545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:04.175251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:04.175802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:04.436712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:04.452484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-24d01074-5294-4a22-a931-71c6700b03ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1274 microversion: 2.1 time: 0.297426 Apr 07 17:20:04.463462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 20/34] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:04 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1274 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:04.531183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:04.532404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:04.545376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:04.552010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:04.559091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:04.561613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:05.471638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:05.472335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:05.486887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:05.489682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:05.492535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:05.494297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:05.748986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:05.763172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d9df7e6b-8768-4079-a2d0-7a747f674216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1280 microversion: 2.1 time: 0.296403 Apr 07 17:20:05.765736 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 21/35] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:05 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1280 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:05.921503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:05.936469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3e771a43-c3dd-4de0-9d13-ce1de3057897 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 1.402872 Apr 07 17:20:05.937368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 15/36] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:04 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:06.407911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-6cf91ac8-4306-4187-963a-2aee09d77da7 req-2d06acad-e71d-4f6c-87f5-baab22a79334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c5c5bdb-94b4-456c-be68-441e1d4b1b74", "tag": "e3a426db-9525-4fc4-90fc-3522fb6ce2cb"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:06.446671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-6cf91ac8-4306-4187-963a-2aee09d77da7 req-2d06acad-e71d-4f6c-87f5-baab22a79334 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:06.447497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-6cf91ac8-4306-4187-963a-2aee09d77da7 req-2d06acad-e71d-4f6c-87f5-baab22a79334 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:06.475306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-6cf91ac8-4306-4187-963a-2aee09d77da7 req-2d06acad-e71d-4f6c-87f5-baab22a79334 service nova] Creating event network-changed:e3a426db-9525-4fc4-90fc-3522fb6ce2cb for instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 on hv-cinder-83699 Apr 07 17:20:06.482268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-6cf91ac8-4306-4187-963a-2aee09d77da7 req-2d06acad-e71d-4f6c-87f5-baab22a79334 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117703) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 07 17:20:06.493488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04a4aefd-66d1-4968-adc3-3b7fc76d3be0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:06.494345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04a4aefd-66d1-4968-adc3-3b7fc76d3be0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:06.508518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04a4aefd-66d1-4968-adc3-3b7fc76d3be0 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:06.510739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04a4aefd-66d1-4968-adc3-3b7fc76d3be0 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:06.554113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.compute.rpcapi [None req-04a4aefd-66d1-4968-adc3-3b7fc76d3be0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 07 17:20:06.557587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04a4aefd-66d1-4968-adc3-3b7fc76d3be0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117703) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 07 17:20:06.618170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1610885232", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48457aee-2d0c-465e-805a-fcb617f3be0e"}], "security_groups": [{"name": "tempest-securitygroup--1668567382"}], "key_name": "tempest-keypair-1793611534", "user_data": "}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:06.626111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-04a4aefd-66d1-4968-adc3-3b7fc76d3be0 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.454232 Apr 07 17:20:06.628642 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 22/37] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:06.785063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:06.785961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:06.815075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:06.818689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:06.819735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:06.820522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:07.118433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:07.121916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] validate_networks() for [('48457aee-2d0c-465e-805a-fcb617f3be0e', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:20:07.151384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6a7b21d7-4fc4-4d68-8f6b-2c010a93effe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1280 microversion: 2.1 time: 0.368023 Apr 07 17:20:07.154577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 23/38] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:06 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1280 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:07.165884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:07.175716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:07.207003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:07.207471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:07.208603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:07.209050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:07.825802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:07.844187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b47b22b9-5c00-45a1-8d32-a818a1a47f3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.687847 Apr 07 17:20:07.845413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 24/39] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:07 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:08.170563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:08.171585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:08.182469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:08.190004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:08.191641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:08.192396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:09.284497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:09.300393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fcac8ecb-4f3f-4de2-a507-5a096df7a8bf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 1.133592 Apr 07 17:20:09.311339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 25/40] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:08 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:09.319805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:09.323081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:09.334369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:09.335074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:09.336142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:09.336737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:09.508515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:20:09.522634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:20:09.522634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:20:09.522634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:20:09.522634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:20:09.531777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:09.533025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:09.534076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:09.534520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:09.575195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for project cb8370d7baf14d80b8e6f7882864649e. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:20:09.583598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for user 93ce92053f4a4fa1a639726b2685cec2 and project cb8370d7baf14d80b8e6f7882864649e. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:20:09.617158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:20:09.622995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:20:09.858548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f4abb9cb-59f5-4066-8c1b-afb678cdb8af tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.249215 Apr 07 17:20:09.861052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 16/41] 10.222.0.26 () {62 vars in 1187 bytes} [Thu Apr 7 17:20:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 3254 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 07 17:20:09.880506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-946abd05-da6e-4d03-8062-89324eb6dbb5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:09.881293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-946abd05-da6e-4d03-8062-89324eb6dbb5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:09.989048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:10.009902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-846ad618-fa62-4bce-8fd0-a4c6090b3e1c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.697027 Apr 07 17:20:10.017800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 26/42] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:09 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:10.319064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:10.319679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:10.345971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:10.348204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:10.355301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:10.357975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:10.411163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-946abd05-da6e-4d03-8062-89324eb6dbb5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:10.424707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-946abd05-da6e-4d03-8062-89324eb6dbb5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:10.430085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-946abd05-da6e-4d03-8062-89324eb6dbb5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:10.435613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-946abd05-da6e-4d03-8062-89324eb6dbb5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1282 microversion: 2.20 time: 0.560709 Apr 07 17:20:10.436896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 17/43] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:09 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1282 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:11.022342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:11.035323 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:11.035955 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:11.066201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:11.067158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:11.067500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:11.071980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-565325e5-6cbd-4ba6-8282-d9a412db5941 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.748234 Apr 07 17:20:11.072703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 27/44] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:10 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:11.080714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:11.457259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c3978e61-0bd9-4e67-b7fb-3a4b31066cf4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:11.457880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c3978e61-0bd9-4e67-b7fb-3a4b31066cf4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:11.697670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c3978e61-0bd9-4e67-b7fb-3a4b31066cf4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:11.715531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c3978e61-0bd9-4e67-b7fb-3a4b31066cf4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:11.724772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c3978e61-0bd9-4e67-b7fb-3a4b31066cf4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:11.742347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c3978e61-0bd9-4e67-b7fb-3a4b31066cf4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1282 microversion: 2.20 time: 0.289582 Apr 07 17:20:11.747467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 28/45] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:11 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:11.765764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-f5d33b7d-aedc-4457-9897-fb4681eaa498 req-f29c1dc5-973b-4bfa-aadc-3424f0bccc9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f29ee7a-7774-4b2a-a97b-d418a22fd251", "tag": "9a780e11-fd18-4861-8227-6aae03c308ca"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:11.824298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-f5d33b7d-aedc-4457-9897-fb4681eaa498 req-f29c1dc5-973b-4bfa-aadc-3424f0bccc9d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:11.824298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-f5d33b7d-aedc-4457-9897-fb4681eaa498 req-f29c1dc5-973b-4bfa-aadc-3424f0bccc9d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:11.845972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-f5d33b7d-aedc-4457-9897-fb4681eaa498 req-f29c1dc5-973b-4bfa-aadc-3424f0bccc9d service nova] Creating event network-changed:9a780e11-fd18-4861-8227-6aae03c308ca for instance 7f29ee7a-7774-4b2a-a97b-d418a22fd251 on hv-cinder-83699 Apr 07 17:20:11.853671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-f5d33b7d-aedc-4457-9897-fb4681eaa498 req-f29c1dc5-973b-4bfa-aadc-3424f0bccc9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103261 Apr 07 17:20:11.854731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 29/46] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:11.996109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:12.015730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-21119870-fc14-4f77-afa7-c696eda98b40 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.985312 Apr 07 17:20:12.018617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 18/47] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:11 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:12.092101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:12.092991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:12.116659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:12.117107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:12.137399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:12.137991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:12.378315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-3b28a9b3-a3b6-4ef7-8848-90933ce13083 req-148ba88a-4753-4da0-b0ce-97fa92e7a9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6861b8a6-c175-4196-998d-c63ddc75145a", "tag": "36b21861-dbf8-4125-9ae9-842aaed8add5"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:12.423415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-3b28a9b3-a3b6-4ef7-8848-90933ce13083 req-148ba88a-4753-4da0-b0ce-97fa92e7a9ba service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:12.430785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-3b28a9b3-a3b6-4ef7-8848-90933ce13083 req-148ba88a-4753-4da0-b0ce-97fa92e7a9ba service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:12.521254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-3b28a9b3-a3b6-4ef7-8848-90933ce13083 req-148ba88a-4753-4da0-b0ce-97fa92e7a9ba service nova] Creating event network-changed:36b21861-dbf8-4125-9ae9-842aaed8add5 for instance 6861b8a6-c175-4196-998d-c63ddc75145a on hv-cinder-83699 Apr 07 17:20:12.526615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-3b28a9b3-a3b6-4ef7-8848-90933ce13083 req-148ba88a-4753-4da0-b0ce-97fa92e7a9ba service nova] Acquired lock "compute-rpcapi-router" {{(pid=117702) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 07 17:20:12.546416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07ee180c-0bfb-4952-ae6d-463b9b1d6070 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:12.550060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07ee180c-0bfb-4952-ae6d-463b9b1d6070 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:12.550060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07ee180c-0bfb-4952-ae6d-463b9b1d6070 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:12.558008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07ee180c-0bfb-4952-ae6d-463b9b1d6070 None None] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:12.603691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.compute.rpcapi [None req-07ee180c-0bfb-4952-ae6d-463b9b1d6070 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 07 17:20:12.607740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07ee180c-0bfb-4952-ae6d-463b9b1d6070 None None] Releasing lock "compute-rpcapi-router" {{(pid=117702) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 07 17:20:12.679615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-07ee180c-0bfb-4952-ae6d-463b9b1d6070 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.480433 Apr 07 17:20:12.681229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 19/48] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:12.775657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:12.778549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:12.793363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:12.794874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:12.796349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:12.798765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:12.880497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:12.889206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-93e5fdf5-9c32-4dbd-9858-ee40f928e68e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.802806 Apr 07 17:20:12.903884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 30/49] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:12 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:12.931316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:12.941004 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:12.943122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:12.944275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-33500f93-4219-46d6-80ae-8356e96f336b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1334 microversion: 2.20 time: 0.183075 Apr 07 17:20:12.945173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 20/50] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:12 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1334 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:13.035763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:13.036385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:13.054180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:13.054693 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:13.055473 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:13.055921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:13.329456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:13.339690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c19535e4-5e7e-458b-8aeb-c5ecd48578e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.309573 Apr 07 17:20:13.342013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 31/51] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:13 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:13.906132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:13.907334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:13.913548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:13.914309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:13.915330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:13.916047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:13.966445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:13.971007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:13.977367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:13.985921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:13.987414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:13.988194 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:14.176985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:14.191685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:14.201014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:14.201244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:14.210470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-15668764-93b5-44bd-9a1a-c44a231d583c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.308042 Apr 07 17:20:14.211775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 21/52] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:13 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:14.212485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-576a030a-8d35-4869-b9ef-d2c7dcf9ba19 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1334 microversion: 2.20 time: 0.246621 Apr 07 17:20:14.214969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 32/53] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:13 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1334 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:14.366820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:14.367484 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:14.392316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:14.396703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:14.401465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:14.401938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:14.646801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:14.656373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c4f64e1b-a437-4c43-bc1a-2ef8d9f1ca3c tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.301879 Apr 07 17:20:14.658747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 22/54] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:14 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:15.237722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:15.247439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:15.247571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:15.249025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:15.249025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:15.249025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:15.249025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:15.249507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:15.283571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:15.286871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:15.289039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:15.291560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:15.426741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:15.437173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:15.442236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:15.447185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a0257b78-9358-43e7-a4e0-b28ac04b7099 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1334 microversion: 2.20 time: 0.213777 Apr 07 17:20:15.447851 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 23/55] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:15 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1334 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:15.585446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:15.593300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a890ad70-0546-48a0-a5f0-bc37f42874a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.365366 Apr 07 17:20:15.593897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 33/56] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:15 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:15.676601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:15.680300 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:15.686991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:15.688803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:15.688803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:15.689011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:15.831684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:15.843778 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7262b165-feeb-49d0-a2e1-5b3b4eb15c54 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.169391 Apr 07 17:20:15.843778 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 24/57] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:15 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:16.465739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:16.466345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:16.472458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:16.473102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:16.474038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:16.474615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:16.537248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:16.547508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:16.548550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:16.550423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1922b438-9838-40df-9517-33ab6bc29cc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1342 microversion: 2.20 time: 0.088624 Apr 07 17:20:16.560934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 34/58] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:16 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1342 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:16.610791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:16.611419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:16.620423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:16.620876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:16.622020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:16.622463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:16.777609 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:16.784514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d148ae21-9a3e-4a28-a64c-1c67928c62f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.177737 Apr 07 17:20:16.785088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 25/59] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:16 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:16.858769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:16.859384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:16.866223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:16.867202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:16.867500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:16.867932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:17.006159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:17.013272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-702bc3c7-6e63-4f58-8be6-e5e7f329aa91 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.158401 Apr 07 17:20:17.013833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 35/60] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:16 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:17.580058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:17.580058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:17.585458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:17.585913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:17.586715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:17.587183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:17.672629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:17.681186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:17.682724 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:17.683828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-669c2eaa-e727-455b-908a-5493c1192b99 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1352 microversion: 2.20 time: 0.109174 Apr 07 17:20:17.684401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 26/61] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:17 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:17.803466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:17.817627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:17.817627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:17.817627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:17.817627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:17.818378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:18.030384 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:18.031267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:18.043970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:18.044913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:18.048509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:18.049128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:18.077164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:18.085819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c3fc2f1f-d35d-4cb9-9a45-27968e6cee5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.286429 Apr 07 17:20:18.102939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 36/62] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:17 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:18.243746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:18.251271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a0d08a7d-46c9-44f9-b906-7fc7446f07a5 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.225422 Apr 07 17:20:18.251850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 27/63] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:18 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:18.705006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:18.705660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:18.713561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:18.714447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:18.715493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:18.715931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:18.923655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:18.926066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:18.928096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:18.929802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c2e5c8f5-05cd-4ee8-8d24-335458a15407 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1340 microversion: 2.20 time: 0.229279 Apr 07 17:20:18.930565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 37/64] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:18 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1340 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:19.107990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:19.108756 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:19.115059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:19.115620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:19.116573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:19.117112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:19.271236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:19.272021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:19.283498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:19.284345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:19.285367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:19.285937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:19.510894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:19.521429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-849dc2c7-6f33-4e54-9f3a-75480ea1777c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.417510 Apr 07 17:20:19.525209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 28/65] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:19 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:19.676323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:19.685932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-979387d2-7452-408d-b66c-f401f8765e53 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.421437 Apr 07 17:20:19.686461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 38/66] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:19 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:19.960296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:19.960296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:19.968490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:19.969682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:19.970674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:19.971304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:20.034993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-013b00fb-dd25-445e-8ddd-1d58059dbd2f req-f70f980b-73ed-4168-999a-d038a4cf9097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5c5bdb-94b4-456c-be68-441e1d4b1b74", "name": "network-vif-plugged", "status": "completed", "tag": "e3a426db-9525-4fc4-90fc-3522fb6ce2cb"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:20.043790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-013b00fb-dd25-445e-8ddd-1d58059dbd2f req-f70f980b-73ed-4168-999a-d038a4cf9097 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:20.044396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-013b00fb-dd25-445e-8ddd-1d58059dbd2f req-f70f980b-73ed-4168-999a-d038a4cf9097 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:20.052170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:20.060978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-013b00fb-dd25-445e-8ddd-1d58059dbd2f req-f70f980b-73ed-4168-999a-d038a4cf9097 service nova] Creating event network-vif-plugged:e3a426db-9525-4fc4-90fc-3522fb6ce2cb for instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 on hv-cinder-83699 Apr 07 17:20:20.061241 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:20.064656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:20.066396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c2a7cc62-7f32-4ee7-bb5d-667f97431871 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1340 microversion: 2.20 time: 0.119592 Apr 07 17:20:20.067865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 29/67] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:19 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1340 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:20.069514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-013b00fb-dd25-445e-8ddd-1d58059dbd2f req-f70f980b-73ed-4168-999a-d038a4cf9097 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118999 Apr 07 17:20:20.070466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 39/68] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:20.538960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:20.539567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:20.551750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:20.552214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:20.553000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:20.553490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:20.699571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:20.708157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:20.709369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:20.721426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:20.721888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:20.722029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-968891eb-7f7e-4958-9261-194c021d3d53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.186584 Apr 07 17:20:20.722677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:20.723148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:20.728716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 30/69] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:20 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:20.872478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:20.880512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1a19e806-9bc6-40d5-b900-3459a94a7f9a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.179576 Apr 07 17:20:20.881091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 40/70] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:20 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:21.085749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:21.086463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:21.092281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:21.092819 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:21.093677 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:21.094133 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:21.598766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:21.612058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:21.614552 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:21.616361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ed541c2-3674-4815-9d28-4bfa942a04e3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.534322 Apr 07 17:20:21.632009 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 31/71] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:21 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:21.748890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:21.750224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:21.765066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:21.765487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:21.770471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:21.770918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:21.899375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:21.899991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:21.908763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:21.909237 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:21.910012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:21.910440 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:22.216084 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:22.226927 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e0c3fca4-c43b-4847-8b7e-2b38894f0d88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.483648 Apr 07 17:20:22.227934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 41/72] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:21 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:22.232921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-7e6d24cd-a9cf-4810-871b-edde1f3eae85 req-781b70eb-db2b-4c58-9a72-c332677cd00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6861b8a6-c175-4196-998d-c63ddc75145a", "name": "network-vif-plugged", "status": "completed", "tag": "36b21861-dbf8-4125-9ae9-842aaed8add5"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:22.242342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-7e6d24cd-a9cf-4810-871b-edde1f3eae85 req-781b70eb-db2b-4c58-9a72-c332677cd00e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:22.243810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-7e6d24cd-a9cf-4810-871b-edde1f3eae85 req-781b70eb-db2b-4c58-9a72-c332677cd00e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:22.253487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:22.260645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-7e6d24cd-a9cf-4810-871b-edde1f3eae85 req-781b70eb-db2b-4c58-9a72-c332677cd00e service nova] Creating event network-vif-plugged:36b21861-dbf8-4125-9ae9-842aaed8add5 for instance 6861b8a6-c175-4196-998d-c63ddc75145a on hv-cinder-83699 Apr 07 17:20:22.261630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5e84fe00-12e1-4a36-a946-5f45034e4dd7 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.368431 Apr 07 17:20:22.268726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-7e6d24cd-a9cf-4810-871b-edde1f3eae85 req-781b70eb-db2b-4c58-9a72-c332677cd00e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039235 Apr 07 17:20:22.269515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 42/73] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:22.270999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 32/74] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:21 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:22.407634 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-ce962f73-1caa-4537-888e-a45437e3e9fc req-21d26476-66a2-483e-b740-839ef88ada76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff11525-d802-480e-8301-be7c4bc7746f", "tag": "bc998428-bafa-45c1-8d70-f3933c8b16ec"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:22.416903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-ce962f73-1caa-4537-888e-a45437e3e9fc req-21d26476-66a2-483e-b740-839ef88ada76 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:22.417452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-ce962f73-1caa-4537-888e-a45437e3e9fc req-21d26476-66a2-483e-b740-839ef88ada76 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:22.429424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-ce962f73-1caa-4537-888e-a45437e3e9fc req-21d26476-66a2-483e-b740-839ef88ada76 service nova] Creating event network-changed:bc998428-bafa-45c1-8d70-f3933c8b16ec for instance bff11525-d802-480e-8301-be7c4bc7746f on hv-cinder-83699 Apr 07 17:20:22.435369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-ce962f73-1caa-4537-888e-a45437e3e9fc req-21d26476-66a2-483e-b740-839ef88ada76 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032985 Apr 07 17:20:22.436065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 43/75] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:22.639598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:22.640201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:22.647086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:22.647533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:22.648296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:22.648730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:22.801656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:22.810624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:22.812395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:22.814295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7bc27664-3b86-4aa2-a047-9840caaa3f09 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.178579 Apr 07 17:20:22.815058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 33/76] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:22 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:23.244358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:23.245513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:23.251763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:23.252421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:23.253370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:23.253817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:23.287546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:23.288151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:23.294177 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:23.294616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:23.295369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:23.295797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:23.432136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:23.440034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-06ffd413-738a-4637-aa9b-9547f6efde64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.200131 Apr 07 17:20:23.440615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 44/77] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:23 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:23.476975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:23.484216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d73ff046-0bf5-44c3-8289-58f467865cea tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.200484 Apr 07 17:20:23.485393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 34/78] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:23 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:23.831860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:23.832522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:23.838395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:23.838838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:23.839597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:23.840027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:23.977294 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:23.985746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:23.987608 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:23.988770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c1ce9841-7646-4853-8992-7782e708bb20 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.160804 Apr 07 17:20:23.992032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 45/79] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:23 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:24.284448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-eb0171d9-bc9c-410f-acb3-2b68858c3f67 req-2c89a554-6ba3-4662-b61f-0a61f7ddc4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f29ee7a-7774-4b2a-a97b-d418a22fd251", "name": "network-vif-plugged", "status": "completed", "tag": "9a780e11-fd18-4861-8227-6aae03c308ca"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:24.292495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-eb0171d9-bc9c-410f-acb3-2b68858c3f67 req-2c89a554-6ba3-4662-b61f-0a61f7ddc4b2 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:24.292921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-eb0171d9-bc9c-410f-acb3-2b68858c3f67 req-2c89a554-6ba3-4662-b61f-0a61f7ddc4b2 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:24.303511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-eb0171d9-bc9c-410f-acb3-2b68858c3f67 req-2c89a554-6ba3-4662-b61f-0a61f7ddc4b2 service nova] Creating event network-vif-plugged:9a780e11-fd18-4861-8227-6aae03c308ca for instance 7f29ee7a-7774-4b2a-a97b-d418a22fd251 on hv-cinder-83699 Apr 07 17:20:24.308410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-eb0171d9-bc9c-410f-acb3-2b68858c3f67 req-2c89a554-6ba3-4662-b61f-0a61f7ddc4b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028253 Apr 07 17:20:24.308991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 35/80] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:20:24.457049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:24.457749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:24.463554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:24.463998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:24.464746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:24.465198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:24.502461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:24.503155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:24.509412 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:24.509870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:24.510644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:24.511085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:24.625033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:24.633410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3019dfb6-0f47-400a-a1df-d2e5e09d74b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.180548 Apr 07 17:20:24.641553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 46/81] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:24 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:24.683329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:24.691141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fe9a1bc2-591a-4cc3-954e-4dc2f5c18c3d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.193108 Apr 07 17:20:24.691934 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 36/82] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:24 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:25.007380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:25.008019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:25.013985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:25.014432 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:25.015206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:25.015635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:25.149504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:25.157853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:25.164163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:25.164163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f3b16033-772d-4654-bf1d-da665ff84fdf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.157020 Apr 07 17:20:25.164163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 47/83] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:25 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:25.652177 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:25.653428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:25.663455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:25.668329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:25.677287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:25.677287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:25.708818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:25.709433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:25.730658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:25.734537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:25.734537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:25.734808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:26.098986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:26.107019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cda3d071-5afe-4288-8061-3b930195c2be tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1315 microversion: 2.1 time: 0.403944 Apr 07 17:20:26.108254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:26.116561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 48/84] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:25 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:26.122494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8945a04c-3fcb-41fc-8cdb-29bdb10c008b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.472161 Apr 07 17:20:26.122494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 37/85] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:25 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:26.177861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:26.178479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:26.184665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:26.185112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:26.185926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:26.186364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:26.492573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:26.500628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:26.502807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:26.503912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e3ba71f6-c5ba-44ed-ae4e-29ce8de149df tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.330083 Apr 07 17:20:26.504476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 49/86] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:26 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:27.123421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:27.124032 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:27.130166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:27.130619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:27.131386 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:27.131823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:27.139320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:27.140071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:27.146674 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:27.147228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:27.148894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:27.148894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:27.333058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:27.340970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7e2456fa-6a6e-47ff-a030-a9889bc2e70f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1502 microversion: 2.1 time: 0.221495 Apr 07 17:20:27.346280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 38/87] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:27 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:27.355769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:27.364394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-08ccd5b2-983b-4188-834d-b2bd2def0e0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1322 microversion: 2.1 time: 0.229436 Apr 07 17:20:27.365118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 50/88] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:27 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:27.526620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:27.526620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:27.534223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:27.534675 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:27.535499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:27.535994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:27.679373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:27.687988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:27.689681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:27.690906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fa6f3bac-e704-44e4-b276-7574dfc5da94 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.172194 Apr 07 17:20:27.691835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 39/89] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:27 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:28.381052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:28.381694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:28.387793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:28.388250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:28.389017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:28.389512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:28.538465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:28.545687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-54b157c9-1b0e-47d5-ae43-cc974f86846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1516 microversion: 2.1 time: 0.168531 Apr 07 17:20:28.546252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 51/90] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:28 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:28.562762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:28.563796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:28.569927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:28.570371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:28.571139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:28.571572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:28.634820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lazy-loading 'flavor' on Instance uuid 7f29ee7a-7774-4b2a-a97b-d418a22fd251 {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:20:28.710214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:28.710959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:28.716861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:28.717413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:28.718202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:28.718718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:28.898180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:28.906700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:28.908259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:28.909397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e2560d7b-c1a3-4110-a046-4e94f0d3ebf9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.203531 Apr 07 17:20:28.909965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 52/91] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:28 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:29.001359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-803986b9-d113-41f7-9053-e348879b5750 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251/action" status: 200 len: 32 microversion: 2.1 time: 0.442469 Apr 07 17:20:29.003423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 40/92] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:20:28 2022] POST /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251/action => generated 32 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 17:20:29.011395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:29.012005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:29.018551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:29.018997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:29.020014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:29.020497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:29.169074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:29.177071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d13149ce-f38d-474c-9f43-38866c8dcd09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.169489 Apr 07 17:20:29.181900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 53/93] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:29 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:29.928051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:29.928769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:29.934793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:29.935224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:29.935987 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:29.936417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:30.108689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:30.116675 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:30.118269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:30.119317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-637e9a74-95c4-4852-9c1b-a8ce2c23858b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.195736 Apr 07 17:20:30.119885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 41/94] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:29 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:30.194148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:30.194772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:30.200884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:30.201373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:30.203934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:30.203934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:30.342239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:30.349422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5b32aacb-3ecf-4e69-914e-d91a6e48ae6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.159272 Apr 07 17:20:30.349994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 54/95] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:30 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:31.137421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:31.138030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:31.143273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c373a4d9-e67a-43a5-af28-08116c4c7e86 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1099d58a-7805-4b6b-ad68-e88b9b094339"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:31.144294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:31.144535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c373a4d9-e67a-43a5-af28-08116c4c7e86 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:31.145003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:31.145949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:31.146388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:31.150831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c373a4d9-e67a-43a5-af28-08116c4c7e86 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:31.151270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c373a4d9-e67a-43a5-af28-08116c4c7e86 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:31.152028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c373a4d9-e67a-43a5-af28-08116c4c7e86 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:31.152458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c373a4d9-e67a-43a5-af28-08116c4c7e86 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:31.305491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:31.313799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:31.316062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:31.317185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8600fa05-6629-4af0-b518-da544422e4cf tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.183835 Apr 07 17:20:31.317786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 42/96] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:31 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:31.367240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:31.367836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:31.374024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:31.374478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:31.375249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:31.375685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:31.505797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:31.512984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bff970b6-83f2-4b9e-ac2a-17bc73cfa6be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.149522 Apr 07 17:20:31.513571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 43/97] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:31 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:32.335192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:32.335800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:32.341600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:32.342047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:32.342803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:32.343237 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:32.492874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:32.500734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:32.502906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:32.504856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-14da9098-ea2f-4cef-979a-730fd74edce8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.172691 Apr 07 17:20:32.511064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 44/98] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:32 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:32.530328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:32.530935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:32.537995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:32.538383 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:32.539247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:32.539683 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:32.678015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:32.685584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-af272dd7-5520-4b8a-abe9-2763f5afb46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.159229 Apr 07 17:20:32.686151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 45/99] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:32 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:33.523610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:33.524206 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:33.530250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:33.530669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:33.531430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:33.531865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:33.711471 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:33.719132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:33.720837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:33.721790 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-efb8d772-6d22-4882-ad0d-5ae472242055 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.202331 Apr 07 17:20:33.722347 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 46/100] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:33 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:33.726645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:33.727236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:33.732916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:33.735183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:33.735183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:33.735183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:33.871059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:33.879243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d6a0fc7c-d44b-42f5-af08-c2bba239e0f0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.155964 Apr 07 17:20:33.879816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 47/101] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:33 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:34.739800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:34.740407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:34.746488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:34.750985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:34.750985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:34.750985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:34.819604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c373a4d9-e67a-43a5-af28-08116c4c7e86 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "POST /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.679759 Apr 07 17:20:34.820595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 55/102] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:20:31 2022] POST /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74/os-volume_attachments => generated 194 bytes in 3682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:20:34.903941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:34.904742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:34.911250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:34.911914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:34.912420 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:34.913563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:34.914013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:34.921994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:34.935488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:34.935488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-74d549e8-84cd-4b5c-866f-0b1bcd57b88c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.188907 Apr 07 17:20:34.935488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 48/103] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:34 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:20:35.066956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:35.075057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-78cb1769-1516-4cc0-a379-2897e48bd025 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.177891 Apr 07 17:20:35.076080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 56/104] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:34 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:35.944762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:35.946176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:35.952561 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:35.953224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:35.953997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:35.954603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:36.094782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:36.096148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:36.108566 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:36.109096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:36.109809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:36.110438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:36.111131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:36.122207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:36.126600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:36.126600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ef0b8b8f-9a40-4d43-97a9-ea3c054a5cfc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.187317 Apr 07 17:20:36.127674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 49/105] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:35 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:36.310110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:36.322160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-64eb32bd-82f6-4e95-bc17-d7168dedeecc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.231246 Apr 07 17:20:36.323043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 57/106] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:36 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:37.155119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:37.155119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:37.159007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:37.159455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:37.160477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:37.160904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:37.307954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:37.315673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:37.317730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:37.318823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-76bae0b9-3d02-467b-83bd-6ac3cefdef22 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.175718 Apr 07 17:20:37.319387 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 50/107] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:37 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:37.339212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:37.339823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:37.346303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:37.346836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:37.347823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:37.348267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:37.510805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:37.521625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0a42345f-ce48-402e-bca2-65718ce79ea6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.186093 Apr 07 17:20:37.530611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 58/108] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:37 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:37.741641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-9bd3fa11-5a8d-42a4-bb11-5b32a4951012 req-fd21e11f-dffd-4423-848b-9e1dcc6d0e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff11525-d802-480e-8301-be7c4bc7746f", "name": "network-vif-plugged", "status": "completed", "tag": "bc998428-bafa-45c1-8d70-f3933c8b16ec"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:37.751006 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-9bd3fa11-5a8d-42a4-bb11-5b32a4951012 req-fd21e11f-dffd-4423-848b-9e1dcc6d0e6e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:37.755852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-9bd3fa11-5a8d-42a4-bb11-5b32a4951012 req-fd21e11f-dffd-4423-848b-9e1dcc6d0e6e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:37.779606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-9bd3fa11-5a8d-42a4-bb11-5b32a4951012 req-fd21e11f-dffd-4423-848b-9e1dcc6d0e6e service nova] Creating event network-vif-plugged:bc998428-bafa-45c1-8d70-f3933c8b16ec for instance bff11525-d802-480e-8301-be7c4bc7746f on hv-cinder-83699 Apr 07 17:20:37.788688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-9bd3fa11-5a8d-42a4-bb11-5b32a4951012 req-fd21e11f-dffd-4423-848b-9e1dcc6d0e6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051793 Apr 07 17:20:37.789333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 51/109] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:20:38.341005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:38.342189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:38.349104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:38.349579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:38.350365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:38.350805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:38.527627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:38.540746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:38.542353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:38.543541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4b7f1359-d941-4997-a9c4-2f24f1bc2300 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.207606 Apr 07 17:20:38.546808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:38.548087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:38.554814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 59/110] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:38 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:38.563463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:38.563991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:38.565358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:38.568539 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:38.732685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:38.741001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cd929860-40be-494f-bd72-529045937dfc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.204699 Apr 07 17:20:38.741635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 52/111] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:38 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:39.561800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:39.563078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:39.569803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:39.570253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:39.571038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:39.571479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:39.733168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:39.741355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:39.742869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:39.743985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9a49b4a8-b867-43ed-9396-301d8a61bb9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1408 microversion: 2.20 time: 0.186074 Apr 07 17:20:39.744549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 60/112] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:39 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:39.758260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:39.759033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:39.764871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:39.765366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:39.766129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:39.766568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:39.932720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:39.940472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b58a010d-6ec9-476d-901b-7543c7710155 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.186192 Apr 07 17:20:39.942228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 53/113] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:39 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:40.762987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:40.763712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:40.771474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:40.772040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:40.773034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:40.773580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:40.922618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:40.933606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:40.936322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:40.937569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fed5ab56-3503-41b6-abbd-63e17f7db26a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1600 microversion: 2.20 time: 0.178680 Apr 07 17:20:40.938460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 61/114] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:20:40 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1600 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:20:40.959634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6067e145-22c1-4f31-a8df-db0b45ff4330 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:40.960827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6067e145-22c1-4f31-a8df-db0b45ff4330 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:40.981213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6067e145-22c1-4f31-a8df-db0b45ff4330 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:40.981672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6067e145-22c1-4f31-a8df-db0b45ff4330 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:40.982470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6067e145-22c1-4f31-a8df-db0b45ff4330 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:40.982913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6067e145-22c1-4f31-a8df-db0b45ff4330 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:40.989296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:40.989750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:41.001728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:41.005052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:41.009160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:41.009807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:41.197904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6067e145-22c1-4f31-a8df-db0b45ff4330 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.242965 Apr 07 17:20:41.205867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 54/115] 10.222.0.26 () {60 vars in 1315 bytes} [Thu Apr 7 17:20:40 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:20:41.258315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:41.270863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a5b3ac6a-5601-4ed3-82d9-a142f4d4cdc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.293559 Apr 07 17:20:41.272808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 62/116] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:40 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:42.296496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:42.297271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:42.308877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:42.308877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:42.311491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:42.312761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:42.474072 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:42.481452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ff9005e9-348d-4a2d-83f1-cd60f3bdac37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.189515 Apr 07 17:20:42.482018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 55/117] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:42 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:43.068229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-9c4a450a-9194-46b9-be1e-86cdefac93c5 req-64fa58a5-5ea0-4fa1-b0d4-a466cd9b7c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bff11525-d802-480e-8301-be7c4bc7746f", "tag": "bc998428-bafa-45c1-8d70-f3933c8b16ec"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:43.087218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-9c4a450a-9194-46b9-be1e-86cdefac93c5 req-64fa58a5-5ea0-4fa1-b0d4-a466cd9b7c3f service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:43.087745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-9c4a450a-9194-46b9-be1e-86cdefac93c5 req-64fa58a5-5ea0-4fa1-b0d4-a466cd9b7c3f service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:43.105981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-9c4a450a-9194-46b9-be1e-86cdefac93c5 req-64fa58a5-5ea0-4fa1-b0d4-a466cd9b7c3f service nova] Creating event network-changed:bc998428-bafa-45c1-8d70-f3933c8b16ec for instance bff11525-d802-480e-8301-be7c4bc7746f on hv-cinder-83699 Apr 07 17:20:43.123929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-9c4a450a-9194-46b9-be1e-86cdefac93c5 req-64fa58a5-5ea0-4fa1-b0d4-a466cd9b7c3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061274 Apr 07 17:20:43.125278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 63/118] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:20:43.499082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:43.499858 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:43.507368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:43.538251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:43.540752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:43.545105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:43.836969 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:43.844465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cf239b2f-29bf-4cd2-a061-b147d9d5373f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.349542 Apr 07 17:20:43.850308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 56/119] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:43 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:44.868249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:44.869558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:44.885469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:44.886540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:44.888479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:44.890968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:44.951236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:44.951236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:44.961718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:44.962648 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:44.964276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:44.965079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:44.993512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:20:45.074104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:45.081915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2665e0e8-e683-4d8c-b3aa-d048134375b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.218411 Apr 07 17:20:45.082490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 64/120] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:44 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:45.252893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e5165575-5785-4173-9f2d-4f5d717faa95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 204 len: 0 microversion: 2.1 time: 0.310749 Apr 07 17:20:45.253681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 57/121] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:20:44 2022] DELETE /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:20:45.265540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:45.266183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:45.272452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:45.272911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:45.273711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:45.274170 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:45.411799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:45.419570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-db5437bc-4f69-4627-9c7a-f1e77657d5e2 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1554 microversion: 2.1 time: 0.157893 Apr 07 17:20:45.420126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 65/122] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:45 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:46.100434 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:46.101171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:46.107565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:46.108124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:46.108907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:46.109504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:46.253915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:46.261429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3c68ec40-01ac-426a-aff0-7cac5c800258 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.165733 Apr 07 17:20:46.261988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 58/123] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:46 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:46.437206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:46.438032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:46.445164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:46.480315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:46.480315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:46.480315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:46.764635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:46.764635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aa4e311e-1072-4982-bd6b-16573c682603 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1554 microversion: 2.1 time: 0.152273 Apr 07 17:20:46.764635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 66/124] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:46 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:47.280038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:47.280794 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:47.286766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:47.287216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:47.287983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:47.288873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:47.429432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:47.437681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-89b343e1-84e5-4fce-8906-0467a4df7953 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.162301 Apr 07 17:20:47.438251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 59/125] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:47 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:47.772350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:47.773022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:47.779279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:47.779821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:47.780622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:47.781054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:47.912606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:47.921310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5d2161e8-579b-469c-9ed7-7f840aa5882f tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1554 microversion: 2.1 time: 0.153119 Apr 07 17:20:47.921972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 67/126] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:47 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:48.455833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:48.456736 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:48.466062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:48.466639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:48.467362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:48.467795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:48.607305 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:48.615883 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4d96c7a1-deb1-4c12-886d-e918fa3bd185 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.164243 Apr 07 17:20:48.616451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 60/127] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:48 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:48.945531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:48.946143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:48.952604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:48.953060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:48.953863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:48.954303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:49.092618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:49.100587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-10e3f4cb-8164-43e1-8f4f-aaacda8fe6d6 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1554 microversion: 2.1 time: 0.159562 Apr 07 17:20:49.101176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 68/128] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:48 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:49.634931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:49.635475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:49.641570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:49.642016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:49.642775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:49.643208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:49.810796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:49.818599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6a0f3d62-e1b7-494f-9722-2c68f08f54df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.189803 Apr 07 17:20:49.819170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 61/129] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:49 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:50.117967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:50.118570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:50.124685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:50.131790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:50.131790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:50.131790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:50.260540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:50.268409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0872e20b-fc13-4db6-ba33-f515b0cfc8fd tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1554 microversion: 2.1 time: 0.154423 Apr 07 17:20:50.269571 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 69/130] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:50 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:50.835920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:50.836855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:50.845948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:50.846502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:50.848018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:50.848632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:51.114473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:51.125025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6ea4f9ca-4317-4097-b28e-50b05b88d226 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.289975 Apr 07 17:20:51.125669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 62/131] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:50 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:51.287933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:51.288585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:51.294619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:51.295293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:51.296234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:51.296680 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:51.924337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:51.934257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bbc80e0c-7587-45a3-b419-ae8ca2dff08a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1554 microversion: 2.1 time: 0.650158 Apr 07 17:20:51.952888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 70/132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:51 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1554 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:52.146759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:52.147376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:52.153844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:52.154451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:52.156808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:52.156808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:52.180413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-47f9f7e1-55d4-4987-b1df-ea730788e642 req-c0f4aff4-d671-41e8-8f7a-55201384db0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c5c5bdb-94b4-456c-be68-441e1d4b1b74", "name": "network-vif-deleted", "tag": "e3a426db-9525-4fc4-90fc-3522fb6ce2cb"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:20:52.191583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-47f9f7e1-55d4-4987-b1df-ea730788e642 req-c0f4aff4-d671-41e8-8f7a-55201384db0b service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:52.192140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-47f9f7e1-55d4-4987-b1df-ea730788e642 req-c0f4aff4-d671-41e8-8f7a-55201384db0b service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:52.208425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-47f9f7e1-55d4-4987-b1df-ea730788e642 req-c0f4aff4-d671-41e8-8f7a-55201384db0b service nova] Creating event network-vif-deleted:e3a426db-9525-4fc4-90fc-3522fb6ce2cb for instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 on hv-cinder-83699 Apr 07 17:20:52.215775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-47f9f7e1-55d4-4987-b1df-ea730788e642 req-c0f4aff4-d671-41e8-8f7a-55201384db0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038819 Apr 07 17:20:52.217518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 71/133] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:20:52.379311 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:52.388831 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f2a0d222-76a3-436d-b69d-7cf99895accd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.249141 Apr 07 17:20:52.389467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 63/134] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:52 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:52.961021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:52.967724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:52.968650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:52.969106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:52.969893 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:52.970489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:53.001936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:53.002422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:53.002878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lazy-loading 'fault' on Instance uuid 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:20:53.047050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:53.055771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f31fac85-68f2-4427-9224-bdeb3509eb95 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1351 microversion: 2.1 time: 0.099861 Apr 07 17:20:53.056339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 72/135] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:52 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:53.407362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:53.408492 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:53.416083 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:53.416523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:53.417498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:53.417929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:53.588020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:53.596357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-559f8d56-540e-4fa7-9c47-8119133f9702 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.193311 Apr 07 17:20:53.596974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 64/136] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:53 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:54.072446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:54.073090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:54.079853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:54.080367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:54.081188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:54.081645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:54.114083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:54.114454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:54.114903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lazy-loading 'fault' on Instance uuid 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:20:54.156789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:54.165521 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a716bc4d-f1eb-4c7f-ba47-5019dc395844 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1351 microversion: 2.1 time: 0.097061 Apr 07 17:20:54.166098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 73/137] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:54 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:54.614182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:54.614942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:54.620817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:54.621279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:54.622035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:54.622476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:54.773337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:54.781404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f06e9577-0a98-4f79-bc2b-263457107d2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.171039 Apr 07 17:20:54.788981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 65/138] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:54 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:55.182785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:55.183465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:55.189861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:55.190373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:55.191193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:55.192290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:55.221444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:55.221885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:55.222322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lazy-loading 'fault' on Instance uuid 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:20:55.264887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:55.273518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-96b0fea4-9e40-4e4b-8d63-09b1115a1cca tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1351 microversion: 2.1 time: 0.094507 Apr 07 17:20:55.274083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 74/139] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:55 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:55.804876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:55.805672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:55.821576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:55.821576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:55.821576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:55.821576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:55.953546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:55.962336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-33bf34d0-df2f-465a-a0fc-b226c55d6266 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.162524 Apr 07 17:20:55.962924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 66/140] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:55 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:56.291368 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:56.292101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:56.298168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:56.298593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:56.299292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:56.299728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:56.330453 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:56.330890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:56.331338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lazy-loading 'fault' on Instance uuid 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:20:56.372289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '992930abf4a84c5fbff0b0dbe188d56c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00415c0a7d44437b37125395140181e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:56.380125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-715e1f39-7ea9-4bca-b081-271ca3b8b14a tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 200 len: 1351 microversion: 2.1 time: 0.094155 Apr 07 17:20:56.380624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 75/141] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:56 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:56.981641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:56.982765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:56.990154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:56.990829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:56.991759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:56.992409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:57.158098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:57.166294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b76a36d7-39ae-4c85-b4bb-b36ada4a4a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.188448 Apr 07 17:20:57.166866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 67/142] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:56 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:20:57.397474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:57.398326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:57.405430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:57.406222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:57.407581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:57.408349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:57.423709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] HTTP exception thrown: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. Apr 07 17:20:57.424317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Returning 404 to user: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:20:57.425174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-846510ca-14b5-4b9f-a533-db4c2c25b539 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 404 len: 111 microversion: 2.1 time: 0.032086 Apr 07 17:20:57.425726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 76/143] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:57 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:20:57.743383 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:57.744300 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:57.750354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:57.750802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:57.751645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:57.752162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:57.764727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] HTTP exception thrown: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. Apr 07 17:20:57.765343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Returning 404 to user: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:20:57.766168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a816efc8-30fd-4b84-aaf1-b312bbb00b09 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027092 Apr 07 17:20:57.766754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 68/144] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:20:57 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74/os-volume_attachments => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:20:58.183428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:58.185062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:58.192502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:58.193671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:58.195387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:58.196434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:58.387022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:58.395728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3e4ef8ef-9929-4e38-975e-69b82427c542 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.215246 Apr 07 17:20:58.397198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 77/145] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:58 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:20:59.246897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:59.247391 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:59.253205 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:59.253654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:59.254408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:59.254892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:59.268595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] HTTP exception thrown: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. Apr 07 17:20:59.269201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Returning 404 to user: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:20:59.270048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f8569dfb-6868-4cb8-97b6-2ec165f1759d tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 404 len: 111 microversion: 2.1 time: 0.027278 Apr 07 17:20:59.270843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 69/146] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:20:59 2022] DELETE /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:20:59.279626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:59.280247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] [instance: 4c5c5bdb-94b4-456c-be68-441e1d4b1b74] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:59.286441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:59.287048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:59.289340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:59.289340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:59.301272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] HTTP exception thrown: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. Apr 07 17:20:59.301867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] Returning 404 to user: Instance 4c5c5bdb-94b4-456c-be68-441e1d4b1b74 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:20:59.303478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a533569e-8d48-49e6-8f2c-03d0d2877e80 tempest-DeleteServersTestJSON-407250252 tempest-DeleteServersTestJSON-407250252-project] 10.222.0.26 "GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74" status: 404 len: 111 microversion: 2.1 time: 0.027883 Apr 07 17:20:59.304219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 78/147] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:59 2022] GET /compute/v2.1/servers/4c5c5bdb-94b4-456c-be68-441e1d4b1b74 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:20:59.420936 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:20:59.422117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:20:59.428148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:59.428594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:59.429397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:20:59.429894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:20:59.656071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:20:59.665873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3c6198e7-34b9-4448-8ab4-1dabb992a2e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.256057 Apr 07 17:20:59.684527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 70/148] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:20:59 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:00.683568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:00.684181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:00.690638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:00.691095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:00.691860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:00.692300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:00.853884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:00.861842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6daaacdc-d612-45a5-a70e-9e97166772e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.182391 Apr 07 17:21:00.862421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 79/149] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:00 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:01.881478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:01.882565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:01.890173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:01.890874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:01.891799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:01.892313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:02.046267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:02.054057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2c76830c-a3aa-46f5-9c68-ddb5b8dfb9e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.178123 Apr 07 17:21:02.054619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 71/150] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:01 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:03.072362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:03.073418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:03.080404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:03.080941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:03.082284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:03.082829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:03.248108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:03.258000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-45c4047b-de3c-45f8-97c3-e6d6890f6bc5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.190496 Apr 07 17:21:03.272790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 80/151] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:03 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:04.280741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:04.281394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:04.292884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:04.293376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:04.294221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:04.294634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:04.522968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:04.533378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-241b7fe8-52f8-46a7-b029-49f9b79e1da8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.257073 Apr 07 17:21:04.537548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 72/152] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:04 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:05.564098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:05.565523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:05.598021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:05.598472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:05.606009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:05.607866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:05.849910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:05.859029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-39bfb8bb-b105-4801-88b8-5f0e00d8df5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.304710 Apr 07 17:21:05.870623 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 81/153] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:05 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:06.878147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:06.879638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:06.886826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:06.887710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:06.888699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:06.889233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:07.048544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:07.057966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ff61b5f6-3490-45ae-852b-3b099095acb2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.184748 Apr 07 17:21:07.059117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 73/154] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:06 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:08.082070 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:08.082685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:08.090766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:08.091533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:08.092891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:08.093718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:08.316384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:08.328895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-912566f7-4905-47d7-b4a2-68586291a4df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.256067 Apr 07 17:21:08.330454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 82/155] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:08 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:09.231027 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-94f1fa9f-0b45-488c-8ee5-664c5e207f9a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'create', calling method: .version_select at 0x7ff9d0f6f700>, body: {"keypair": {"name": "tempest-keypair-139772271"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:09.249098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-94f1fa9f-0b45-488c-8ee5-664c5e207f9a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:21:09.253250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-94f1fa9f-0b45-488c-8ee5-664c5e207f9a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for user 94e99c7ac26f44f3953fe1296cd5248b and project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:21:09.346545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:09.347293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:09.355364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:09.356057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:09.356863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:09.357465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:09.502437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:09.510741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8e466d09-6e17-4c92-8788-62767becefe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.168288 Apr 07 17:21:09.511319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 83/156] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:09 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:09.551894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-94f1fa9f-0b45-488c-8ee5-664c5e207f9a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:21:09.557960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-94f1fa9f-0b45-488c-8ee5-664c5e207f9a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for user 94e99c7ac26f44f3953fe1296cd5248b and project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:21:09.578012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-94f1fa9f-0b45-488c-8ee5-664c5e207f9a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.464332 Apr 07 17:21:09.578551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 74/157] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:21:09 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:10.528094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:10.529245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:10.535821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:10.536874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:10.538104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:10.538823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:10.803937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:10.823984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-81bd7ce2-2efa-4619-9c24-4a5bf411d90a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.299897 Apr 07 17:21:10.838314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 84/158] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:10 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:11.845799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:11.846521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:11.853805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:11.854398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:11.855469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:11.856253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:12.104207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:12.137248 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c15e46b6-f856-481f-ac81-e9497b46591f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.283428 Apr 07 17:21:12.137248 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 75/159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:11 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:21:12.687799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2057640950", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1853f71-2509-481a-81b6-2c17c428061c"}], "security_groups": [{"name": "tempest-securitygroup--1099124474"}], "key_name": "tempest-keypair-139772271", "user_data": "}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:12.882836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] validate_networks() for [('d1853f71-2509-481a-81b6-2c17c428061c', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:21:13.151621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:13.152339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:13.174830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:13.180180 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:13.180986 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:13.181445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:13.362954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:13.372048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-046d0d3f-5ccc-47c1-b3a6-56209f219ec7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.224217 Apr 07 17:21:13.377267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 76/160] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:13 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:13.602292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:21:13.602719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:21:13.603193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:21:13.603602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:21:13.604035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:21:13.612902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:13.613381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:13.614179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:13.614665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:13.637066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:21:13.641071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for user 94e99c7ac26f44f3953fe1296cd5248b and project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:21:13.653495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:21:13.656457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:21:13.808579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c9108a00-3905-4e01-8346-043e2a52d6d0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.125880 Apr 07 17:21:13.809555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 85/161] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:21:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:21:13.819977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cd772be0-15f1-45d0-be0e-b981d0973f83 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:13.820919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cd772be0-15f1-45d0-be0e-b981d0973f83 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:13.875203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cd772be0-15f1-45d0-be0e-b981d0973f83 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:13.899295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cd772be0-15f1-45d0-be0e-b981d0973f83 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1237 microversion: 2.1 time: 0.082155 Apr 07 17:21:13.899295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 77/162] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:13 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:14.392736 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:14.395100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:14.404738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:14.405457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:14.406241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:14.406683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:14.550569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:14.560006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fcf77238-b4ab-45df-9763-bf0df5629e02 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.173748 Apr 07 17:21:14.560880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 86/163] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:14 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:14.914317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:14.914928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:14.920899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:14.921390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:14.922154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:14.922585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:14.993427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:15.005961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ac3f0dab-9fcd-4273-a3fc-7684b2ac439d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1241 microversion: 2.1 time: 0.094847 Apr 07 17:21:15.006779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 78/164] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:14 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:15.577367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:15.578014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:15.584626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:15.585318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:15.586091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:15.586738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:15.729690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:15.737334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-482c2172-6810-4619-a493-01ed5de42117 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.164112 Apr 07 17:21:15.738394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 87/165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:15 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:16.024548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:16.025214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:16.031383 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:16.032063 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:16.032899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:16.033577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:16.099564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:16.107181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-52cd36c3-c5f0-4268-a362-9caadca009e4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1241 microversion: 2.1 time: 0.087662 Apr 07 17:21:16.107748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 79/166] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:16 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:16.756739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:16.758168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:16.764985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:16.765616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:16.767261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:16.768110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:16.932739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:16.932739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5f1d792a-fbba-4e96-8e48-a39286fc4d32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.177139 Apr 07 17:21:16.932739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 88/167] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:16 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:17.126010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:17.127745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:17.136051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:17.136565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:17.137701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:17.138477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:17.216151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:17.225354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-273c8a15-f5fd-4b52-8a0c-8a6de3015671 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1241 microversion: 2.1 time: 0.103124 Apr 07 17:21:17.225354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 80/168] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:17 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:17.948393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:17.949112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:17.955807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:17.956258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:17.957050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:17.957507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:18.099689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:18.107936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4251b9c9-9805-4476-bc1f-addb73cc7998 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.163924 Apr 07 17:21:18.108505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 89/169] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:17 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:18.240646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:18.243501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:18.247502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:18.247952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:18.248759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:18.249390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:18.310625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:18.319010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-49129a39-a58d-4294-bf53-461810ac0dab tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1241 microversion: 2.1 time: 0.082472 Apr 07 17:21:18.319485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 81/170] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:18 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:19.125383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:19.126036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:19.133480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:19.133938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:19.134821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:19.135263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:19.290583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:19.296832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-17328dac-65b6-4e25-9372-79ec3b0695cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1522 microversion: 2.1 time: 0.175109 Apr 07 17:21:19.297551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 90/171] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:19 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:19.344558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:19.346060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:19.354612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:19.355124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:19.355889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:19.356315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:19.416802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:19.423994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-291d4a42-d511-46f4-b350-a539abd49370 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1289 microversion: 2.1 time: 0.093137 Apr 07 17:21:19.424564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 82/172] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:19 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:20.315698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:20.316250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:20.323304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:20.323752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:20.324513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:20.324948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:20.442038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:20.443525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:20.449814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:20.450587 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:20.451979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:20.452772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:20.463883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:20.471273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f2e37577-01ed-4971-8a98-4ad20c74f69f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1502 microversion: 2.1 time: 0.159484 Apr 07 17:21:20.471848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 91/173] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:20 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:20.488019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:20.488405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:20.494501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:20.495351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:20.495781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:20.496221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:20.523718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:20.534521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-821f3419-1847-448d-aae8-f81707671d6d tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1297 microversion: 2.1 time: 0.096244 Apr 07 17:21:20.536037 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 83/174] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:20 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:21:20.951515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:20.959538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e06950ce-15f8-4def-b075-3c86deb65ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1516 microversion: 2.1 time: 0.475534 Apr 07 17:21:20.960125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 92/175] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:20 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1516 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:21.558514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:21.559304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:21.566373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:21.567182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:21.568937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:21.569608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:21.658911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:21.672810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4f572bdb-41bc-41aa-9f59-e96810ccd1f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1295 microversion: 2.1 time: 0.124156 Apr 07 17:21:21.677880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 84/176] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:21 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1295 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:22.695238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:22.695916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:22.702667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:22.703115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:22.703891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:22.704328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:22.814873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:22.816718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:22.826098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:22.826795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:22.827926 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:22.829822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:22.861213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lazy-loading 'flavor' on Instance uuid 6861b8a6-c175-4196-998d-c63ddc75145a {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:21:22.942696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:22.965873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d725e2f9-9d6a-436a-8071-b22951e08227 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.263906 Apr 07 17:21:22.965873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 93/177] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:22 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:22.965873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-7a16180e-dc99-41fa-9fe8-7c1cfc9d9499 req-565116c0-92fc-41bc-af64-56139cbd3d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48aed11-0395-43fe-8a15-18ec4fc83ae2", "tag": "74eba21d-dbe0-4928-ab98-03294512797f"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:22.970727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-7a16180e-dc99-41fa-9fe8-7c1cfc9d9499 req-565116c0-92fc-41bc-af64-56139cbd3d16 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:22.971169 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-7a16180e-dc99-41fa-9fe8-7c1cfc9d9499 req-565116c0-92fc-41bc-af64-56139cbd3d16 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:22.983318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-7a16180e-dc99-41fa-9fe8-7c1cfc9d9499 req-565116c0-92fc-41bc-af64-56139cbd3d16 service nova] Creating event network-changed:74eba21d-dbe0-4928-ab98-03294512797f for instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 on hv-cinder-83699 Apr 07 17:21:22.988189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-7a16180e-dc99-41fa-9fe8-7c1cfc9d9499 req-565116c0-92fc-41bc-af64-56139cbd3d16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030740 Apr 07 17:21:22.988785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 94/178] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:21:23.275105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4e482e8b-4da4-4765-ab3a-2c89cd637668 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a/action" status: 200 len: 32 microversion: 2.1 time: 0.465547 Apr 07 17:21:23.276411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 85/179] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:21:22 2022] POST /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 07 17:21:23.293721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:23.294417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:23.303792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:23.304246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:23.305094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:23.305693 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:23.643567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:23.659750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f2208b4d-6082-4b45-ad57-db21e7e21d80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.374441 Apr 07 17:21:23.660544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 95/180] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:23 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:23.973542 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:23.975196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:23.981508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:23.982128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:23.983156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:23.983793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:24.138492 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:24.146652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-49a0ee86-55aa-4fe9-9c6e-cc3f8b570c2c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.177417 Apr 07 17:21:24.147317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 86/181] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:23 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:24.678175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:24.678999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:24.687889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:24.693434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:24.693434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:24.693434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:24.894370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:24.914068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a7581908-71e5-436e-84bb-6006a804f610 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.240770 Apr 07 17:21:24.920672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 96/182] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:24 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:25.164834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:25.166355 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:25.173170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:25.173965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:25.175631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:25.176287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:25.478803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:25.486954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b66a34d0-269f-47e2-b8a3-849875ae7a71 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.326645 Apr 07 17:21:25.488151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 87/183] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:25 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:25.938706 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:25.939936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:25.946769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:25.954253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:25.954253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:25.954253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:26.119288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:26.126647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7f0b9c23-ba10-4ff5-8232-3bcc9ed5bd4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.191882 Apr 07 17:21:26.127094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 97/184] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:25 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:26.506733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:26.507378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:26.513309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:26.513759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:26.514522 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:26.514991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:26.709091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:26.717068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c0a6db48-adea-4f30-a7c2-a1f6eb695cff tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.215867 Apr 07 17:21:26.717653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 88/185] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:26 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:27.144367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:27.146206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:27.152934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:27.153496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:27.154362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:27.154865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:27.374185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:27.385722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c9e3c6bd-3283-422f-8e35-e89d1c4a01ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.245592 Apr 07 17:21:27.386610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 98/186] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:27 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:27.747634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:27.747634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:27.747634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:27.747634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:27.748489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:27.748489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:27.925280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:27.936834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0965ea70-f1f7-40ff-9d3e-ac5217d0a3a0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.206104 Apr 07 17:21:27.941396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 89/187] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:27 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:28.404020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:28.404653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:28.411109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:28.412084 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:28.412859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:28.413327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:28.569982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:28.577465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0f111c06-fc80-4afd-a636-61a6ba1664ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.177327 Apr 07 17:21:28.578033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 99/188] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:28 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:28.957450 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:28.958053 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:28.963811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:28.964255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:28.965012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:28.965478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:29.106206 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:29.118142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9491070e-9e55-4da8-934e-cba30ec41e66 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.164321 Apr 07 17:21:29.118860 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 90/189] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:28 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:29.594769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:29.595464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:29.602415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:29.602861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:29.603899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:29.604341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:29.758303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:29.765631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3325603a-6860-4567-9266-fd2f6b84ad9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.174719 Apr 07 17:21:29.766208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 100/190] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:29 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:30.135719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:30.136378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:30.142889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:30.143343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:30.148143 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:30.149319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:30.310641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:30.320350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-20b27bae-6db7-44aa-9bca-46f5cff2402b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.188538 Apr 07 17:21:30.321079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 91/191] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:30 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:30.783295 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:30.783856 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:30.790275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:30.790717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:30.791481 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:30.791915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:30.938271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-c1deae10-23fd-47e8-8927-bdd90e6da9c9 req-7799141a-1d37-4662-b67b-c7af1d8dc802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48aed11-0395-43fe-8a15-18ec4fc83ae2", "name": "network-vif-plugged", "status": "completed", "tag": "74eba21d-dbe0-4928-ab98-03294512797f"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:30.938984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:30.947389 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-c1deae10-23fd-47e8-8927-bdd90e6da9c9 req-7799141a-1d37-4662-b67b-c7af1d8dc802 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:30.947685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-43a02d15-2c4e-478a-8649-528ded905531 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.168313 Apr 07 17:21:30.947960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-c1deae10-23fd-47e8-8927-bdd90e6da9c9 req-7799141a-1d37-4662-b67b-c7af1d8dc802 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:30.948268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 101/192] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:30 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:30.959896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-c1deae10-23fd-47e8-8927-bdd90e6da9c9 req-7799141a-1d37-4662-b67b-c7af1d8dc802 service nova] Creating event network-vif-plugged:74eba21d-dbe0-4928-ab98-03294512797f for instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 on hv-cinder-83699 Apr 07 17:21:30.965069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-c1deae10-23fd-47e8-8927-bdd90e6da9c9 req-7799141a-1d37-4662-b67b-c7af1d8dc802 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 Apr 07 17:21:30.965769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 92/193] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:21:31.338631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:31.339496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:31.350538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:31.351098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:31.352159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:31.352613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:31.515103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:31.524578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-974754e3-cb50-44ef-b9af-9c382e500938 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.190615 Apr 07 17:21:31.525273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 102/194] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:31 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:31.966447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:31.967345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:31.974410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:31.975006 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:31.975787 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:31.976223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:32.112829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:32.121380 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-57832d96-37a1-4aae-8782-5e61a39206bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.159443 Apr 07 17:21:32.121989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 93/195] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:31 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:32.544262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:32.545269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:32.553211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:32.553679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:32.555185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:32.556245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:32.735326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:32.754158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-03323e86-1962-416e-a899-93c61bff0fdf tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1363 microversion: 2.1 time: 0.203500 Apr 07 17:21:32.754158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 103/196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:32 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:33.139820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:33.140407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:33.152714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:33.152714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:33.152714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:33.152714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:33.298814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:33.306622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a87ccddb-2480-403c-8326-fe14429fee47 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.170663 Apr 07 17:21:33.307304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 94/197] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:33 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:33.764100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:33.764704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:33.772235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:33.772680 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:33.773476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:33.773904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:33.922363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:33.930699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-acf3b5d9-d1cf-449b-bf46-f41d2e74e541 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1549 microversion: 2.1 time: 0.170915 Apr 07 17:21:33.931352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 104/198] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:33 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:33.947302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-04bbc463-4004-481e-80d9-b9cb8b23adc7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:33.947829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-04bbc463-4004-481e-80d9-b9cb8b23adc7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:33.953759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04bbc463-4004-481e-80d9-b9cb8b23adc7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:33.954198 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04bbc463-4004-481e-80d9-b9cb8b23adc7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:33.954953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04bbc463-4004-481e-80d9-b9cb8b23adc7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:33.955376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04bbc463-4004-481e-80d9-b9cb8b23adc7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:34.040641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-04bbc463-4004-481e-80d9-b9cb8b23adc7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097368 Apr 07 17:21:34.041281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 95/199] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Apr 7 17:21:33 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:21:34.325346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:34.326183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:34.333449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:34.334241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:34.335225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:34.335861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:34.778672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:34.786868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3e00ea01-9603-4053-b54c-045fd569b882 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.466032 Apr 07 17:21:34.787499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 105/200] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:34 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:35.647692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-3d03eeed-7525-45b1-a1c8-4594275a1072 req-fd90475b-6e03-4323-a9b0-be53eb6e7337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48aed11-0395-43fe-8a15-18ec4fc83ae2", "tag": "74eba21d-dbe0-4928-ab98-03294512797f"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:35.656563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-3d03eeed-7525-45b1-a1c8-4594275a1072 req-fd90475b-6e03-4323-a9b0-be53eb6e7337 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:35.657898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-3d03eeed-7525-45b1-a1c8-4594275a1072 req-fd90475b-6e03-4323-a9b0-be53eb6e7337 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:35.670393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-3d03eeed-7525-45b1-a1c8-4594275a1072 req-fd90475b-6e03-4323-a9b0-be53eb6e7337 service nova] Creating event network-changed:74eba21d-dbe0-4928-ab98-03294512797f for instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 on hv-cinder-83699 Apr 07 17:21:35.675866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-3d03eeed-7525-45b1-a1c8-4594275a1072 req-fd90475b-6e03-4323-a9b0-be53eb6e7337 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032932 Apr 07 17:21:35.676589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 96/201] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:21:35.804899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:35.806181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:35.812254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:35.812703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:35.813676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:35.814272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:36.280307 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:36.298202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d1ebdc71-401c-4c30-bef1-8bca965bc3ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.498071 Apr 07 17:21:36.298811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 106/202] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:35 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:37.316183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:37.316986 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:37.327226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:37.327923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:37.328855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:37.329487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:37.469107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:37.477981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-36efc049-d6c4-4ceb-9e09-704eb2a3ca4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.165988 Apr 07 17:21:37.478564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 97/203] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:37 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:38.500342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:38.501599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:38.509001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:38.509479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:38.510256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:38.510694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:38.659435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:38.668031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-51886fd8-9299-409e-90c9-4d1f6cd80f8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.172032 Apr 07 17:21:38.668847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 107/204] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:38 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:38.762982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bd170920-e5c8-4ccf-bbd3-1bfe07a576a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:38.763565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bd170920-e5c8-4ccf-bbd3-1bfe07a576a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:38.769880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd170920-e5c8-4ccf-bbd3-1bfe07a576a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:38.772476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd170920-e5c8-4ccf-bbd3-1bfe07a576a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:38.773280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd170920-e5c8-4ccf-bbd3-1bfe07a576a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:38.773873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd170920-e5c8-4ccf-bbd3-1bfe07a576a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:38.799016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bd170920-e5c8-4ccf-bbd3-1bfe07a576a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/ips" status: 200 len: 152 microversion: 2.20 time: 0.039792 Apr 07 17:21:38.800367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 98/205] 10.222.0.26 () {60 vars in 1288 bytes} [Thu Apr 7 17:21:38 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:21:39.687895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:39.688503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:39.695296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:39.695827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:39.696686 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:39.697150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:39.899498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:39.907540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e3ea2e21-b383-43d3-a288-814b8806b478 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.223899 Apr 07 17:21:39.908240 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 108/206] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:39 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:40.927039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:40.927901 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:40.936546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:40.936546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:40.936546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:40.936546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:41.096334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:41.104972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-77b1a35b-2906-4e0a-a7d8-b4665ff287aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.182501 Apr 07 17:21:41.105583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 99/207] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:40 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:42.123201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:42.123860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:42.130777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:42.131236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:42.132190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:42.132637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:42.273658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:42.281028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1ec48943-2b6f-4453-9eab-4a366566087c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.161757 Apr 07 17:21:42.281622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 109/208] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:42 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:42.405168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:42.405708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:42.412364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:42.412805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:42.413663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:42.414094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:42.438638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lazy-loading 'flavor' on Instance uuid bff11525-d802-480e-8301-be7c4bc7746f {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:21:43.006447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3fba07b2-9a5c-4e36-8394-6048b1fb29c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "POST /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/action" status: 202 len: 0 microversion: 2.20 time: 0.604881 Apr 07 17:21:43.008890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 100/209] 10.222.0.26 () {62 vars in 1318 bytes} [Thu Apr 7 17:21:42 2022] POST /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:21:43.019826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:43.021336 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:43.027140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:43.027590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:43.028341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:43.028805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:43.164003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:43.171915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:43.173440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:43.174577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fac3a314-bc5d-4f7f-8e5b-ac65154db7bb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.158741 Apr 07 17:21:43.175215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 110/210] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:43 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:43.299564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:43.300258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:43.306903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:43.307349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:43.308522 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:43.308989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:43.455970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:43.464170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1e80fdfd-8506-49a0-87df-eb720a2297a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.168964 Apr 07 17:21:43.474915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 101/211] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:43 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:44.193716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:44.194315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:44.200836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:44.201329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:44.202099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:44.202538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:44.339118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:44.347466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:44.350229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:44.351381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9f178725-af6c-4028-9af8-e35521c4811a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.162024 Apr 07 17:21:44.351939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 111/212] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:44 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:44.483893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:44.485226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:44.494777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:44.496165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:44.496962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:44.497445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:44.664069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:44.671521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e69f7643-8120-4495-967b-a94da32381ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.192823 Apr 07 17:21:44.672090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 102/213] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:44 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:45.371415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:45.372017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:45.378503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:45.378946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:45.380362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:45.381319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:45.528343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:45.537582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:45.539377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:45.540716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-849d95bf-24ac-49cd-8bf3-6ee64c1cd6fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.173320 Apr 07 17:21:45.541295 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 112/214] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:45 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:45.687921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:45.688688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:45.695474 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:45.695982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:45.696685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:45.697118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:45.834881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:45.842556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-996b617c-031b-4755-b7ac-7b9a89015809 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.158538 Apr 07 17:21:45.843404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 103/215] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:45 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:46.559700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:46.560392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:46.566928 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:46.567926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:46.568746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:46.569320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:46.730931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:46.742233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:46.743801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:46.745010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6ac89e42-b569-4f32-91e6-4ffb4be1e2c2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.189141 Apr 07 17:21:46.757206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 113/216] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:46 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:46.860613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:46.868944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:46.868944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:46.868944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:46.869862 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:46.870300 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.005331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:47.016066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-252df84a-af73-4dcd-bbf9-044f6554e7c2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1502 microversion: 2.1 time: 0.159298 Apr 07 17:21:47.016665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 104/217] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:46 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:21:47.033552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e6a5827-81ff-4864-82e3-206ef6a6b84e"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:47.034705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:47.041719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.042959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.043365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.043902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.068262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] HTTP exception thrown: Cannot 'attach_volume' instance 6861b8a6-c175-4196-998d-c63ddc75145a while it is in vm_state rescued Apr 07 17:21:47.068915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Returning 409 to user: Cannot 'attach_volume' instance 6861b8a6-c175-4196-998d-c63ddc75145a while it is in vm_state rescued {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:21:47.069777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ca723a3a-3b2d-407d-a751-3392a9a05405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040240 Apr 07 17:21:47.070325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 114/218] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:21:47 2022] POST /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 07 17:21:47.078990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1019ba82-3ef9-4ee1-8289-64ede887f3d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:21:47.079520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1019ba82-3ef9-4ee1-8289-64ede887f3d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:47.086135 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1019ba82-3ef9-4ee1-8289-64ede887f3d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.086581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1019ba82-3ef9-4ee1-8289-64ede887f3d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.087339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1019ba82-3ef9-4ee1-8289-64ede887f3d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.087773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1019ba82-3ef9-4ee1-8289-64ede887f3d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.306660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1019ba82-3ef9-4ee1-8289-64ede887f3d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a/action" status: 202 len: 0 microversion: 2.1 time: 0.231229 Apr 07 17:21:47.307221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 105/219] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:21:47 2022] POST /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:21:47.315158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:47.315792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:47.321838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.322283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.323032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.323460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.454937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:47.463002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-96dee247-6367-4bef-9cfc-62d8b293e18a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.151640 Apr 07 17:21:47.463587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 115/220] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:47 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:47.767751 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:47.768497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:47.775869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.776350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.777122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:47.777592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:47.912937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:47.920615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:47.923720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:47.923720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0f274a15-5b7d-4013-9ae0-d4b4378449b4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.159818 Apr 07 17:21:47.923911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 106/221] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:47 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:48.480601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:48.481247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:48.487450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:48.487898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:48.488658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:48.489918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:48.625352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:48.633654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1961c85a-7a0d-48ef-8578-571dc6e37f85 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.156988 Apr 07 17:21:48.634226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 116/222] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:48 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:48.941837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:48.942914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:48.948834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:48.949307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:48.950067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:48.950493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:49.087070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:49.094836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:49.096258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:49.097500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1655732a-bcab-48d2-bc5f-710a2b9f8904 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.159356 Apr 07 17:21:49.101185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 107/223] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:48 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:49.651510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:49.652138 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:49.659813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:49.666990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:49.666990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:49.666990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:49.862790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:49.871299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f716271b-6ff8-41cb-aa3c-3d8fda8eefbd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.223827 Apr 07 17:21:49.872037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 117/224] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:49 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:50.118100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:50.119256 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:50.128285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:50.129186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:50.130215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:50.130803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:50.276514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:50.287157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:50.288960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:50.290241 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5cd989f8-9af2-4658-8c46-2b9ef89814b2 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.176394 Apr 07 17:21:50.290864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 108/225] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:50 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:50.890370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:50.890370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:50.896605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:50.897046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:50.897858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:50.898323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:51.036809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:51.044346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fa57f6af-41e3-4803-ac53-623699b58e6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.160321 Apr 07 17:21:51.044911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 118/226] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:50 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:51.311612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:51.312686 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:51.321975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:51.322425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:51.323404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:51.323845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:51.466873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:51.475326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:51.476825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:51.477993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-db401a0a-dd81-4d38-8a60-ff0683447b90 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.171572 Apr 07 17:21:51.478551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 109/227] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:51 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:52.062616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:52.064406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:52.073305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:52.074214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:52.075552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:52.076050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:52.263686 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:52.272090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1ffb5704-1b9b-48c9-b2e0-27e4a5435a4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.214183 Apr 07 17:21:52.272654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 119/228] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:52 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:52.496414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:52.497008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:52.502998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:52.503447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:52.504209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:52.505279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:52.637105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:52.644985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:52.647437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:52.648654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ffc81a3a-4015-4c2e-94a7-2d9449138380 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.156210 Apr 07 17:21:52.650001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 110/229] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:52 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:53.289887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:53.290447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:53.296648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:53.297095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:53.297887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:53.298355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:53.430539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:53.437904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9b2b2912-5614-4028-997b-944307960119 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.151998 Apr 07 17:21:53.438477 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 120/230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:53 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:53.668024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:53.668714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:53.675577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:53.676034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:53.677655 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:53.679182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:53.808646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:53.816283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:53.818283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:53.819436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-509fe165-01e6-4f18-8f25-7fed3a483515 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.155345 Apr 07 17:21:53.819990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 111/231] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:53 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:54.455124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:54.455728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:54.465304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:54.465688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:54.466507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:54.466939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:54.606081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:54.613632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b97a6212-d816-4c40-94d1-5f9e916113b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.162351 Apr 07 17:21:54.614235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 121/232] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:54 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:54.838469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:54.839095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:54.845365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:54.845827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:54.846596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:54.847032 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:54.984294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:54.993805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:54.994928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:54.996092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1c3f683c-1384-4faa-922c-3b0722d0af1b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.161648 Apr 07 17:21:55.003070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 112/233] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:54 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:55.633244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:55.633775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:55.640166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:55.640620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:55.641418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:55.641859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:55.779014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:55.787220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-102ef556-5397-4a4a-ac7e-4a273f745020 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.158715 Apr 07 17:21:55.788967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 122/234] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:55 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:56.018016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:56.018610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:56.026670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:56.027178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:56.028099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:56.028567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:56.166102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:56.173763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:56.175265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:56.176917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b1d8eab8-60a4-4e68-ace9-fd4ac98977d9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.162389 Apr 07 17:21:56.177568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 113/235] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:56 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:56.804057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:56.804657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:56.810863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:56.811309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:56.812064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:56.812491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:56.942241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:56.949771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-08677c9d-2cac-4cd5-a15a-e9731f923565 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.150028 Apr 07 17:21:56.950342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 123/236] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:56 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:57.196821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:57.197466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:57.203453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:57.203927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:57.204689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:57.205124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:57.369463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:57.377407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:57.379008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:57.380244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bb6c49a6-6d90-4ff1-a2e9-189268092ab4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.187905 Apr 07 17:21:57.381767 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 114/237] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:57 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:57.967586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:57.968193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:57.974988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:57.975438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:57.976202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:57.976631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:58.110329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:58.118764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2850b471-4b36-4628-99ee-10ee93a14b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.154949 Apr 07 17:21:58.119391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 124/238] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:57 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:58.399919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:58.400420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:58.406289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:58.406733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:58.407482 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:58.407913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:58.541904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:58.549629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:58.551157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:58.552295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6969009d-0cc2-4029-a23d-5c3ab72422c3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.156839 Apr 07 17:21:58.553057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 115/239] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:58 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:21:59.138732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:59.139320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:59.145784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:59.146538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:59.147303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:59.147728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:59.281699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:59.289414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aa2c40bb-bded-4d1e-8d54-405bb2a50ccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.154684 Apr 07 17:21:59.289972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 125/240] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:21:59 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:21:59.572603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:21:59.573310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:21:59.579418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:59.579857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:59.580609 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:21:59.581031 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:21:59.710948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:59.718750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:59.720239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:21:59.721405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ee002f50-64ef-442b-a799-0d7fb4e0397d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.153734 Apr 07 17:21:59.721965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 116/241] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:21:59 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:00.306533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:00.307128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:00.313375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:00.313820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:00.314569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:00.315001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:00.447771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:00.455070 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-74ca5318-0a27-4515-8263-94b33034701a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.152745 Apr 07 17:22:00.455634 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 126/242] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:00 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:00.741895 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:00.742502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:00.748816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:00.749315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:00.750084 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:00.750538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:00.884765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:00.892828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:00.894377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:00.895616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-48f05d05-a6ef-4066-8ef9-7d5023244ad0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.159160 Apr 07 17:22:00.896191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 117/243] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:00 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:01.473428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:01.474045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:01.480353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:01.480799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:01.481582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:01.482018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:01.617634 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:01.625121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7a3ecc91-0521-4f54-bb17-50fa9dcf3907 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.155701 Apr 07 17:22:01.636328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 127/244] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:01 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:01.915388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:01.915990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:01.921925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:01.922373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:01.923121 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:01.923581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:02.051952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:02.059939 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:02.061426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:02.062583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-215819b2-f2dd-4f92-9225-977cf889bb27 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.152085 Apr 07 17:22:02.063149 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 118/245] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:01 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:02.644057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:02.644426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:02.651674 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:02.652116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:02.653062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:02.653602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:02.792640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:02.799932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f7c8123e-d31c-47f0-8409-f1d100be2255 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1510 microversion: 2.1 time: 0.160075 Apr 07 17:22:02.800499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 128/246] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:02 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:03.080934 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:03.081473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:03.087478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:03.087920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:03.088668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:03.089097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:03.220609 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:03.229201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:03.230702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:03.231839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ea0ca04-ff1b-4a97-a3a9-4397f4d6e7f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.154821 Apr 07 17:22:03.232391 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 119/247] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:03 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:03.817720 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:03.818304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:03.825291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:03.825784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:03.826549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:03.826984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:03.994965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:04.002500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-95995097-700a-4c19-87d4-52f3e112471a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1516 microversion: 2.1 time: 0.188702 Apr 07 17:22:04.003259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 129/248] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:03 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:04.250905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:04.251501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:04.257576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:04.258025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:04.258818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:04.259217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:04.392906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:04.401324 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:04.406036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:04.406036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1b01fbfd-38ef-448a-ac1f-6e04aaa71194 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.156984 Apr 07 17:22:04.406036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 120/249] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:04 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:05.422284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:05.422950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:05.429127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:05.430200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:05.430964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:05.431392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:05.569776 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:05.579261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:05.580795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:05.582024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-df1d44b8-2c47-433d-b720-d5a7c16c08e5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.163547 Apr 07 17:22:05.593457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 130/250] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:05 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:06.603392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:06.603996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:06.610062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:06.610502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:06.611258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:06.611687 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:06.747776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:06.755497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:06.756984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:06.758801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ec9c465f-1c1d-40ea-9496-a6e69d5b48a8 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.159438 Apr 07 17:22:06.759361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 121/251] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:06 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:07.738002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c3948e49-4e58-4443-b5e2-f9eacb750b9f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'create', calling method: .version_select at 0x7ff9d06748b0>, body: {"keypair": {"name": "tempest-keypair-1487888967"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:07.753954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c3948e49-4e58-4443-b5e2-f9eacb750b9f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:22:07.760566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c3948e49-4e58-4443-b5e2-f9eacb750b9f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for user 9717b85343d14a1c919091f29a591763 and project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:22:07.788037 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:07.789733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:07.798282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:07.798993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:07.805635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:07.808664 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:07.978234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c3948e49-4e58-4443-b5e2-f9eacb750b9f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:22:07.987768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c3948e49-4e58-4443-b5e2-f9eacb750b9f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for user 9717b85343d14a1c919091f29a591763 and project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:22:07.993902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:08.002400 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:08.002542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c3948e49-4e58-4443-b5e2-f9eacb750b9f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.268290 Apr 07 17:22:08.003395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 131/252] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:22:07 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:08.011281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:08.013003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-19f6a978-930e-4577-8701-c80aa634905b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.238633 Apr 07 17:22:08.013801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 122/253] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:07 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:09.036766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:09.037842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:09.044957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:09.045441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:09.046209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:09.046652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:09.188547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:09.196479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:09.198045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:09.199469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-43e15d85-5c5b-4de0-8efb-5780db7d511e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1746 microversion: 2.20 time: 0.170852 Apr 07 17:22:09.200289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 132/254] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:09 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:10.217592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:10.218194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:10.226255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:10.227061 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:10.234217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:10.234217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:10.504745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:10.514327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:10.515857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:10.517063 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a433d758-abb3-4dd5-b9d2-25eae32475e4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1746 microversion: 2.20 time: 0.303279 Apr 07 17:22:10.517657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 123/255] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:10 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1746 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:10.556737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-635962035", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a08d8121-3795-4290-8edc-155198c9e461"}], "security_groups": [{"name": "tempest-securitygroup--426680111"}], "key_name": "tempest-keypair-1487888967", "user_data": "}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:10.760286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] validate_networks() for [('a08d8121-3795-4290-8edc-155198c9e461', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:22:11.326265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:22:11.326690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:22:11.327167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:22:11.327591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:22:11.328002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:22:11.337601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:11.338051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:11.338855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:11.339291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:11.355576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:22:11.359472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Getting quotas for user 9717b85343d14a1c919091f29a591763 and project 03828970d20c4ed09fa9c9ec412782ec. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:22:11.370619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:22:11.372899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:22:11.517092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-94c6b146-ce99-4522-bf21-21cd7729c171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.965165 Apr 07 17:22:11.517815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 133/256] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:22:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:22:11.528867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8d3c4571-3f75-4fe8-894a-2cfabdd21e9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:11.530180 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8d3c4571-3f75-4fe8-894a-2cfabdd21e9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:11.543610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:11.543610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:11.560043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:11.560747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:11.561626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:11.562075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:11.589048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8d3c4571-3f75-4fe8-894a-2cfabdd21e9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:11.597848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8d3c4571-3f75-4fe8-894a-2cfabdd21e9e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1245 microversion: 2.1 time: 0.072508 Apr 07 17:22:11.599076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 124/257] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:11.759958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:11.770858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:11.772717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:11.775813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-92bb1d43-f985-4c15-b4db-139756e59106 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.237503 Apr 07 17:22:11.776857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 134/258] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:11 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:12.616881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:12.618036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:12.624707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:12.625170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:12.625940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:12.626486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:12.753686 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:12.763849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-39f46ac2-2cf6-418f-96af-41d658aa07b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1249 microversion: 2.1 time: 0.152448 Apr 07 17:22:12.774125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 125/259] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1249 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:12.801637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:12.802884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:12.810546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:12.811158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:12.814354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:12.815110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:13.100384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:13.116241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:13.120332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:13.123002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ed19ba48-9aee-4362-874f-4f818cc882d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.325657 Apr 07 17:22:13.123973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 135/260] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:12 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:13.214738 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-8c610589-52f8-498d-bbd6-9bb15dca62dc req-8d94cb73-c5aa-4c10-9f15-b18a8596ac79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff11525-d802-480e-8301-be7c4bc7746f", "name": "network-vif-plugged", "status": "completed", "tag": "bc998428-bafa-45c1-8d70-f3933c8b16ec"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:13.232388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-8c610589-52f8-498d-bbd6-9bb15dca62dc req-8d94cb73-c5aa-4c10-9f15-b18a8596ac79 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:13.232388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-8c610589-52f8-498d-bbd6-9bb15dca62dc req-8d94cb73-c5aa-4c10-9f15-b18a8596ac79 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:13.242501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-8c610589-52f8-498d-bbd6-9bb15dca62dc req-8d94cb73-c5aa-4c10-9f15-b18a8596ac79 service nova] Creating event network-vif-plugged:bc998428-bafa-45c1-8d70-f3933c8b16ec for instance bff11525-d802-480e-8301-be7c4bc7746f on hv-cinder-83699 Apr 07 17:22:13.248330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-8c610589-52f8-498d-bbd6-9bb15dca62dc req-8d94cb73-c5aa-4c10-9f15-b18a8596ac79 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043731 Apr 07 17:22:13.249168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 126/261] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:22:13.782049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:13.783011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:13.791354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:13.792146 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:13.793003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:13.793472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:13.883841 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:13.899789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8e63fc5e-d6ca-4bd8-8d63-9063123d2f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1241 microversion: 2.1 time: 0.122179 Apr 07 17:22:13.915040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 136/262] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:14.144972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:14.149808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:14.163114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:14.163706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:14.165090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:14.165559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:14.395674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:14.406076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:14.410852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:14.417970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b943cf70-2054-4b04-a8c8-e39b573893fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.275272 Apr 07 17:22:14.429215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 127/263] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:14 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:14.919220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:14.919727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:14.941798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:14.942299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:14.944016 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:14.944602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:15.047659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:15.056524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6eca4ff0-8716-42c3-a8b2-b54f6c2f67bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1241 microversion: 2.1 time: 0.142931 Apr 07 17:22:15.071966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 137/264] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1241 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:15.442316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:15.443627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:15.450201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:15.456503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:15.456503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:15.456503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:15.713011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:15.722472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:15.724228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:15.725735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-352437da-59df-402e-a55d-cac5ecef57ad tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.289686 Apr 07 17:22:15.727774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 128/265] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:15 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:16.075794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:16.076711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:16.088250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:16.088744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:16.089814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:16.090279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:16.191198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:16.199823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4b8c15c3-b661-45f7-9bb8-dabf2814298e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1297 microversion: 2.1 time: 0.129170 Apr 07 17:22:16.200418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 138/266] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1297 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:16.749043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:16.750940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:16.758499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:16.765377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:16.765377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:16.765377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:17.008826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:17.017972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:17.021941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:17.025217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4eb1f9bd-bd14-4d1f-9b8f-66fa810a688f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.283493 Apr 07 17:22:17.037039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 129/267] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:16 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:17.218802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:17.219417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:17.227356 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:17.228447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:17.229255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:17.229698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:17.322141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:17.331666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0da43504-6702-4f47-aef5-037204fe00f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1315 microversion: 2.1 time: 0.116653 Apr 07 17:22:17.342136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 139/268] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1315 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:18.054383 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:18.055837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:18.092753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:18.099766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:18.101125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:18.102123 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:18.354766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:18.355384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:18.364551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:18.374353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:18.375396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:18.376890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:18.389613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:18.391532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:18.395355 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:18.400948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4aefad5d-a73c-498e-8e57-a5e5ff4e54a9 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.357897 Apr 07 17:22:18.402973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 130/269] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:18 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:18.777208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:18.786685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-78fe529a-c8a9-4be4-b88b-dae38081479e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1370 microversion: 2.1 time: 0.434717 Apr 07 17:22:18.796561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 140/270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1370 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:19.441755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:19.444323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-90c60539-150a-4c62-9b90-6e87b5a70aca req-9452504f-26bf-4392-b9f3-30dda1104b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3966d8bc-6664-4582-a275-e7dcfbcba3cc", "tag": "47442b13-f258-4d3e-a668-6710428db8ce"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:19.447158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:19.472674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:19.485660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:19.498790 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:19.499284 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:19.503662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-90c60539-150a-4c62-9b90-6e87b5a70aca req-9452504f-26bf-4392-b9f3-30dda1104b6e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:19.505246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-90c60539-150a-4c62-9b90-6e87b5a70aca req-9452504f-26bf-4392-b9f3-30dda1104b6e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:19.569893 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-90c60539-150a-4c62-9b90-6e87b5a70aca req-9452504f-26bf-4392-b9f3-30dda1104b6e service nova] Creating event network-changed:47442b13-f258-4d3e-a668-6710428db8ce for instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc on hv-cinder-83699 Apr 07 17:22:19.583593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-90c60539-150a-4c62-9b90-6e87b5a70aca req-9452504f-26bf-4392-b9f3-30dda1104b6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156614 Apr 07 17:22:19.584824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 141/271] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:22:19.803783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:19.805770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:19.816613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:19.822403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:19.824033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:19.824694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:19.848012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:19.856395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:19.857949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:19.859133 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b80f3b6b-221d-4e2a-b6be-b2cdbe26f830 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.442516 Apr 07 17:22:19.859698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 131/272] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:19 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:20.098151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:20.106827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ba31d883-2bdc-4d37-8417-9373c77eb31f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1370 microversion: 2.1 time: 0.308201 Apr 07 17:22:20.119649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 142/273] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1370 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:20.877599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:20.878292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:20.885032 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:20.885581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:20.886349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:20.886780 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:21.037884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:21.048403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:21.051102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:21.052271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a8f36e76-ce3e-473d-983b-87c275dfbc2a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.178729 Apr 07 17:22:21.052837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 132/274] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:20 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:21.124426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:21.125256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:21.131379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:21.131827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:21.132595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:21.133050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:21.300599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:21.324058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-24599179-1007-4bb1-af03-a40d82aa3879 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1370 microversion: 2.1 time: 0.187940 Apr 07 17:22:21.324834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 143/275] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1370 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:22.076316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:22.078380 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:22.088273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:22.089203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:22.091020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:22.091020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:22.342966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:22.343671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:22.355758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:22.356235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:22.357043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:22.358767 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:22.393070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:22.405313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:22.420714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:22.425217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1e6fed94-5ea4-4366-8dc9-c6ad9273a3d0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.354473 Apr 07 17:22:22.425617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 133/276] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:22 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:22.600870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:22.657617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-34c386ae-6395-4452-bb79-1c666767ae92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1370 microversion: 2.1 time: 0.319947 Apr 07 17:22:22.666597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 144/277] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1370 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:23.443472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:23.444070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:23.453563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:23.454001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:23.455613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:23.458362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:23.686237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:23.687833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:23.700752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:23.703800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:23.707644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:23.708277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:23.993483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:24.005405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:24.011762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:24.013249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9c070781-b2f1-448f-a202-6edae3b5f7a4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.573879 Apr 07 17:22:24.014034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 134/278] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:23 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:24.044578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:24.059663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-42f4a8ad-4314-4907-8821-1f2aa2100b53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1370 microversion: 2.1 time: 0.381289 Apr 07 17:22:24.064059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 145/279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1370 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:25.038439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:25.040571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:25.050832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:25.051275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:25.052080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:25.052524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:25.086502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:25.087187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:25.098874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:25.100730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:25.104548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:25.109531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:25.434297 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:25.440503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:25.451251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-46252fe7-67cb-4841-8f76-91b88625a5d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1370 microversion: 2.1 time: 0.375143 Apr 07 17:22:25.451913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 146/280] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:25.457251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-45e88d4a-07cd-4e60-a94e-5cf36f4038cf req-adacb1d1-d73f-4ed5-a863-93fc69cbf844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3966d8bc-6664-4582-a275-e7dcfbcba3cc", "name": "network-vif-plugged", "status": "completed", "tag": "47442b13-f258-4d3e-a668-6710428db8ce"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:25.472170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:25.472170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:25.472170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5f3429f1-6eb2-4cac-8710-f8b5d3d959fb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.436046 Apr 07 17:22:25.476704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 135/281] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:25 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:25.502733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-45e88d4a-07cd-4e60-a94e-5cf36f4038cf req-adacb1d1-d73f-4ed5-a863-93fc69cbf844 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:25.502733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-45e88d4a-07cd-4e60-a94e-5cf36f4038cf req-adacb1d1-d73f-4ed5-a863-93fc69cbf844 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:25.502733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-45e88d4a-07cd-4e60-a94e-5cf36f4038cf req-adacb1d1-d73f-4ed5-a863-93fc69cbf844 service nova] Creating event network-vif-plugged:47442b13-f258-4d3e-a668-6710428db8ce for instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc on hv-cinder-83699 Apr 07 17:22:25.502733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-45e88d4a-07cd-4e60-a94e-5cf36f4038cf req-adacb1d1-d73f-4ed5-a863-93fc69cbf844 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045163 Apr 07 17:22:25.502733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 147/282] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:22:26.468772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:26.470302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:26.478759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:26.479422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:26.480825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:26.481496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:26.495676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:26.497036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:26.514221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:26.515117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:26.516177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:26.520540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:26.799110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:26.809216 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:26.810737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:26.811922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2f3d95d0-ce90-4e1b-8109-4a4b01310aaa tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.320901 Apr 07 17:22:26.812525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 148/283] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:26 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:26.814144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:26.832669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ac186fda-2625-454d-a28c-60ac010535cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1370 microversion: 2.1 time: 0.367743 Apr 07 17:22:26.833445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 136/284] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1370 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:27.830937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:27.831538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:27.839499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:27.840025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:27.840697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:27.843887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:27.852546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:27.854007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:27.860250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:27.860703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:27.861498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:27.861933 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:28.097834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:28.106659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:28.110399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:28.110399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:28.110650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5ce3a69a-756c-45b8-a555-f12b0abe5c63 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1741 microversion: 2.20 time: 0.283469 Apr 07 17:22:28.111064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 149/285] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:27 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1741 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:28.121783 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a65b128a-26ad-4610-93bc-d0ee0369fbd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1565 microversion: 2.1 time: 0.267306 Apr 07 17:22:28.128404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 137/286] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1565 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:28.132194 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8e9946d0-1baa-4d0c-84d4-29c12fdfac00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:28.132704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e9946d0-1baa-4d0c-84d4-29c12fdfac00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:28.139244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9946d0-1baa-4d0c-84d4-29c12fdfac00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:28.147124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9946d0-1baa-4d0c-84d4-29c12fdfac00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:28.147124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9946d0-1baa-4d0c-84d4-29c12fdfac00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:28.147124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9946d0-1baa-4d0c-84d4-29c12fdfac00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:28.226124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8e9946d0-1baa-4d0c-84d4-29c12fdfac00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098023 Apr 07 17:22:28.226748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 150/287] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Apr 7 17:22:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:22:29.128873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:29.130045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:29.136449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:29.137123 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:29.138151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:29.138679 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:29.769055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:29.779587 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:29.781097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:29.782912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a5be4c3d-4984-4927-b389-c80aab3a67d7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1723 microversion: 2.20 time: 0.658296 Apr 07 17:22:29.783481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 138/288] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:29 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:30.014217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-d5ecc91d-5e53-4a42-8723-91d583fcb6ec req-451736d1-666a-4287-b9d5-828d8b95e55a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3966d8bc-6664-4582-a275-e7dcfbcba3cc", "tag": "47442b13-f258-4d3e-a668-6710428db8ce"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:30.020555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-d5ecc91d-5e53-4a42-8723-91d583fcb6ec req-451736d1-666a-4287-b9d5-828d8b95e55a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:30.020999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-d5ecc91d-5e53-4a42-8723-91d583fcb6ec req-451736d1-666a-4287-b9d5-828d8b95e55a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:30.034195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-d5ecc91d-5e53-4a42-8723-91d583fcb6ec req-451736d1-666a-4287-b9d5-828d8b95e55a service nova] Creating event network-changed:47442b13-f258-4d3e-a668-6710428db8ce for instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc on hv-cinder-83699 Apr 07 17:22:30.039293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-d5ecc91d-5e53-4a42-8723-91d583fcb6ec req-451736d1-666a-4287-b9d5-828d8b95e55a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031577 Apr 07 17:22:30.041414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 151/289] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:22:30.674837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1240977502", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "networks": [{"uuid": "98029ca3-40af-49f8-8ff3-47599a1cc35d"}]}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:30.735061 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] validate_networks() for [('98029ca3-40af-49f8-8ff3-47599a1cc35d', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:22:30.807508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:30.817656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:30.823924 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:30.824611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:30.826226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:30.826834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:31.195293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:31.207992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:31.211587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:31.213087 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8d7fc276-8b40-4fe4-93f7-0e6b509be7e7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1723 microversion: 2.20 time: 0.410671 Apr 07 17:22:31.214510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 152/290] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:30 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:31.219835 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fb8ea07b-5373-4973-8249-e3147a2074df tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:31.227277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fb8ea07b-5373-4973-8249-e3147a2074df tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:31.227415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:22:31.227415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:22:31.227415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:22:31.227415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:22:31.227415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:22:31.227829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb8ea07b-5373-4973-8249-e3147a2074df tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:31.228025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb8ea07b-5373-4973-8249-e3147a2074df tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:31.229204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb8ea07b-5373-4973-8249-e3147a2074df tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:31.229879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb8ea07b-5373-4973-8249-e3147a2074df tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:31.236126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:31.236569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:31.237383 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:31.237814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:31.256606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Getting quotas for project 81110c4ea45c46a88291fe2527aabd46. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:22:31.258916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fb8ea07b-5373-4973-8249-e3147a2074df tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/ips" status: 200 len: 145 microversion: 2.1 time: 0.043082 Apr 07 17:22:31.259898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 153/291] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:22:31 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:22:31.267481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Getting quotas for user 1e941f28846a4bd8ab78dfbdaf7115e2 and project 81110c4ea45c46a88291fe2527aabd46. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:22:31.283629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:22:31.291572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:22:31.508655 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c23fa1ce-4086-41e0-986a-898379135824 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836997 Apr 07 17:22:31.523097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b5fdae66-c1ef-4fed-85b9-8203e627445c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:31.524937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b5fdae66-c1ef-4fed-85b9-8203e627445c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:31.529295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 139/292] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:22:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:22:31.630086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b5fdae66-c1ef-4fed-85b9-8203e627445c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:31.643103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b5fdae66-c1ef-4fed-85b9-8203e627445c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1219 microversion: 2.1 time: 0.126057 Apr 07 17:22:31.645780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 154/293] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:31 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1219 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:32.232151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:32.232745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:32.240297 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:32.247801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:32.248667 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:32.249732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:32.456929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:32.464887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:32.466523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:32.467740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d4bd761e-463e-42ad-9cd1-31d562f62cf6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1726 microversion: 2.20 time: 0.239684 Apr 07 17:22:32.468388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 140/294] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:32 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1726 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:32.490556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-87a6455c-1590-463b-87cd-e736472a92cb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "554435eb-d0dc-417e-9472-fa0a1a7e7f4e"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:32.491669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-87a6455c-1590-463b-87cd-e736472a92cb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:32.498475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87a6455c-1590-463b-87cd-e736472a92cb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:32.498920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87a6455c-1590-463b-87cd-e736472a92cb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:32.499674 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87a6455c-1590-463b-87cd-e736472a92cb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:32.500104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87a6455c-1590-463b-87cd-e736472a92cb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:32.666980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-94a8d088-0e8b-4381-a0ae-eb4dd24f8123 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:32.668132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-94a8d088-0e8b-4381-a0ae-eb4dd24f8123 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:32.734352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-94a8d088-0e8b-4381-a0ae-eb4dd24f8123 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:32.741487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-94a8d088-0e8b-4381-a0ae-eb4dd24f8123 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1219 microversion: 2.1 time: 0.081229 Apr 07 17:22:32.742182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 141/295] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:32 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:33.092988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-1ede71b7-bd87-4d7e-8d20-321b2ab8ff71 req-3d8aa63f-3a8f-4327-8721-56bab15124d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff11525-d802-480e-8301-be7c4bc7746f", "name": "network-vif-unplugged", "status": "completed", "tag": "bc998428-bafa-45c1-8d70-f3933c8b16ec"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:33.101303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-1ede71b7-bd87-4d7e-8d20-321b2ab8ff71 req-3d8aa63f-3a8f-4327-8721-56bab15124d4 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:33.102468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-1ede71b7-bd87-4d7e-8d20-321b2ab8ff71 req-3d8aa63f-3a8f-4327-8721-56bab15124d4 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:33.113398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.compute.server_external_events [req-1ede71b7-bd87-4d7e-8d20-321b2ab8ff71 req-3d8aa63f-3a8f-4327-8721-56bab15124d4 service nova] Unable to find a host for instance bff11525-d802-480e-8301-be7c4bc7746f. Dropping event network-vif-unplugged {{(pid=117702) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 07 17:22:33.114272 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-1ede71b7-bd87-4d7e-8d20-321b2ab8ff71 req-3d8aa63f-3a8f-4327-8721-56bab15124d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025326 Apr 07 17:22:33.114856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 142/296] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 07 17:22:33.690828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-87a6455c-1590-463b-87cd-e736472a92cb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "POST /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.204221 Apr 07 17:22:33.691547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 155/297] 10.222.0.26 () {62 vars in 1363 bytes} [Thu Apr 7 17:22:32 2022] POST /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments => generated 188 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:22:33.760039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:33.760039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:33.765859 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:33.766313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:33.767057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:33.767527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:33.813163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-30418ee1-7d1c-4a0e-bded-1721b1c25948 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:33.814039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-30418ee1-7d1c-4a0e-bded-1721b1c25948 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:33.822336 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30418ee1-7d1c-4a0e-bded-1721b1c25948 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:33.822336 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30418ee1-7d1c-4a0e-bded-1721b1c25948 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:33.823327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30418ee1-7d1c-4a0e-bded-1721b1c25948 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:33.823898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30418ee1-7d1c-4a0e-bded-1721b1c25948 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:33.834091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:33.841514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-046fc3bd-daef-4a38-bf2b-8d7fea0b65c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1271 microversion: 2.1 time: 0.086828 Apr 07 17:22:33.842169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 143/298] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:33 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:34.036734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-33065b17-b133-4c18-91ba-9713235ee2ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea6a3bff-f6d7-4252-9883-4237c1748612"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:34.037863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-33065b17-b133-4c18-91ba-9713235ee2ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:34.045451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33065b17-b133-4c18-91ba-9713235ee2ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:34.045897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33065b17-b133-4c18-91ba-9713235ee2ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:34.046667 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33065b17-b133-4c18-91ba-9713235ee2ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:34.047097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33065b17-b133-4c18-91ba-9713235ee2ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:34.100154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-30418ee1-7d1c-4a0e-bded-1721b1c25948 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "POST /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/action" status: 202 len: 0 microversion: 2.20 time: 0.290944 Apr 07 17:22:34.104821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 156/299] 10.222.0.26 () {62 vars in 1318 bytes} [Thu Apr 7 17:22:33 2022] POST /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:22:34.112516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:34.115030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:34.131529 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:34.133868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:34.134769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:34.136118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:34.428013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:34.437380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:34.439353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:34.440721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9282751e-a6c1-4404-98ef-1c31318f2de4 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1752 microversion: 2.20 time: 0.334599 Apr 07 17:22:34.441528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 157/300] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:34 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1752 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:34.864381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:34.865208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:34.877815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:34.878271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:34.879056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:34.881443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:34.969036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:34.976415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c345422d-da3f-415b-8219-902c31a12b54 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1277 microversion: 2.1 time: 0.117618 Apr 07 17:22:34.977978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 158/301] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:34 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1277 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:35.022125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-33065b17-b133-4c18-91ba-9713235ee2ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.988874 Apr 07 17:22:35.023189 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 144/302] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:22:34 2022] POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-volume_attachments => generated 194 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:22:35.462077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:35.462981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:35.481916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:35.483107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:35.483987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:35.494990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:35.848074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:35.870301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:35.873575 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:35.874961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-463a7850-a0f6-4500-b182-0114a812d76e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1752 microversion: 2.20 time: 0.418579 Apr 07 17:22:35.875945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 159/303] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:35 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1752 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:35.996437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:35.997477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:36.004179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:36.004627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:36.005462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:36.005900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:36.254370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:36.262356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eef505d6-467b-49a0-8845-82910eebd4db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.271710 Apr 07 17:22:36.273912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 145/304] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:35 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:36.519892 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-b7c97fb7-e3a8-4c14-828d-7fd474ccef4c req-3a3a1544-541a-4c8d-87b4-b3c8c9417583 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4797990b-2d5a-44f8-a9bd-b96d6919d4f0", "tag": "611756c2-2e59-4286-aab5-5bb98b5b9133"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:36.533082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-b7c97fb7-e3a8-4c14-828d-7fd474ccef4c req-3a3a1544-541a-4c8d-87b4-b3c8c9417583 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:36.534076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-b7c97fb7-e3a8-4c14-828d-7fd474ccef4c req-3a3a1544-541a-4c8d-87b4-b3c8c9417583 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:36.548994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-b7c97fb7-e3a8-4c14-828d-7fd474ccef4c req-3a3a1544-541a-4c8d-87b4-b3c8c9417583 service nova] Creating event network-changed:611756c2-2e59-4286-aab5-5bb98b5b9133 for instance 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 on hv-cinder-83699 Apr 07 17:22:36.554501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-b7c97fb7-e3a8-4c14-828d-7fd474ccef4c req-3a3a1544-541a-4c8d-87b4-b3c8c9417583 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038629 Apr 07 17:22:36.556169 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 160/305] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:22:36.894658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:36.895427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:36.903263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:36.906195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:36.906195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:36.906195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:37.281198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:37.282792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:37.299907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:37.300746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:37.301799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:37.302449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:37.583567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:37.598800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:37.600555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:37.603183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-36772e47-087e-474e-90cb-4b00cb318b74 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1754 microversion: 2.20 time: 0.712353 Apr 07 17:22:37.604598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 146/306] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:36 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1754 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:37.628130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:37.638551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6cf72a6e-a486-49d1-8282-505a24fd01d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.362031 Apr 07 17:22:37.639722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 161/307] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:37 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:38.623195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:38.623195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:38.634480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:38.635103 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:38.639002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:38.639621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:38.662337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:38.663620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:38.678807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:38.679491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:38.680685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:38.681124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:38.920968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:38.931946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:38.934900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:38.939049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-454aa575-452f-4a28-92c4-a2568bb0bd9f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1754 microversion: 2.20 time: 0.320689 Apr 07 17:22:38.940321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:38.941813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 147/308] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:38 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1754 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:38.950307 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d85b1e11-d514-476a-bbe6-2f75a8d1fee2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.298141 Apr 07 17:22:38.952929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 162/309] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:38 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:39.960063 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:39.960701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:39.967700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:39.968195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:39.968836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:39.969298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:39.969512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:39.969617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:39.976118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:39.977075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:39.978444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:39.978883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:40.188852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:40.203146 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:40.208779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:40.213417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:40.216792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2948fe6d-896e-4f31-add3-bc118e8f696b tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1754 microversion: 2.20 time: 0.260831 Apr 07 17:22:40.217444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 148/310] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:39 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1754 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:40.220155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-20b8db81-9928-44a6-98b0-0550525fef08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.254895 Apr 07 17:22:40.221199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 163/311] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:39 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:41.236289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:41.238256 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:41.242896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:41.243514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:41.250157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:41.251123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:41.251427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:41.252374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:41.252501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:41.252501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:41.253273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:41.253882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:41.526901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:41.538216 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0188b3d2-2cd7-4eb2-aa9a-f90c20a12e47 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.299052 Apr 07 17:22:41.540670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 164/312] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:41 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:41.547948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:41.556777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:41.558317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:41.559473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-312a6b3a-72f2-4a3c-a6d8-80153dcfd3a3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1754 microversion: 2.20 time: 0.326998 Apr 07 17:22:41.560025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 149/313] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:41 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1754 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:42.556305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:42.556948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:42.567727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:42.569770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:42.571668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:42.572745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:42.578521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:42.579008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:42.589080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:42.589563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:42.591077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:42.591077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:42.878497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:42.888551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7b417c1c-9bac-4993-8148-d56f89a18931 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.335264 Apr 07 17:22:42.900554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 165/314] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:42 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:42.906888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dad81002-43b8-440d-b728-d0180484986f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:42.908268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:42.914669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dad81002-43b8-440d-b728-d0180484986f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:42.915360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dad81002-43b8-440d-b728-d0180484986f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:42.918875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:42.922292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:42.922518 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8d1002d7-03cd-4090-89af-33004ab67a7e tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1754 microversion: 2.20 time: 0.347894 Apr 07 17:22:42.924540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 150/315] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:42 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1754 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:42.997654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dad81002-43b8-440d-b728-d0180484986f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Going to try to stop instance {{(pid=117703) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 07 17:22:43.210409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dad81002-43b8-440d-b728-d0180484986f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.307924 Apr 07 17:22:43.213652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 166/316] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:22:42 2022] POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:22:43.221268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:43.223691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:43.232649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:43.233969 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:43.235066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:43.235709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:43.449884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:43.463627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c66e4ff6-b0ae-4f1d-adc2-6a577df39cfc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.243517 Apr 07 17:22:43.479170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 151/317] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:43 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:43.907477 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:43.908183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:43.915241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:43.915838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:43.916616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:43.917057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:43.947189 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:43.948038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:43.956874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:43.959798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:43.962406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:43.962946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:44.458662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:44.458662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:44.460239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:44.460239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-617600a1-7467-4839-9673-737467d0304d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.439764 Apr 07 17:22:44.462237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:44.462473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 152/318] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:43 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:44.463065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5413b98c-8341-432a-a06c-e6a57b81ad56 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.500000 Apr 07 17:22:44.463065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 167/319] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:43 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:44.481631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:44.482414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:44.492031 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:44.498595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:44.499114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:44.499676 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:44.843916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:44.853260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b4dfd7ad-9776-4e53-8aff-3eb85cf66cd5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.375145 Apr 07 17:22:44.856673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 153/320] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:44 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:45.467123 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:45.467854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:45.468618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:45.470556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:45.479259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:45.479709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:45.480678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:45.481671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:45.493214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:45.497384 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:45.501052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:45.501664 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:45.729222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:45.748382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-db460ecf-9df1-41de-8e51-8bf6e858a241 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.285221 Apr 07 17:22:45.749104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 168/321] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:45 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:45.796448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:45.806540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:45.808537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:45.809925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-be27221a-716e-45d1-a03c-d396438a3095 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.346943 Apr 07 17:22:45.811042 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 154/322] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:45 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:45.865239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-3d487081-d667-4135-98bc-21547ded012e req-ab58dd59-7495-4eec-93fe-8b63ae69482b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797990b-2d5a-44f8-a9bd-b96d6919d4f0", "name": "network-vif-plugged", "status": "completed", "tag": "611756c2-2e59-4286-aab5-5bb98b5b9133"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:45.878616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:45.878616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:45.891104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:45.894605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:45.895445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:45.899896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-3d487081-d667-4135-98bc-21547ded012e req-ab58dd59-7495-4eec-93fe-8b63ae69482b service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:45.900347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-3d487081-d667-4135-98bc-21547ded012e req-ab58dd59-7495-4eec-93fe-8b63ae69482b service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:45.904556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:45.936542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-3d487081-d667-4135-98bc-21547ded012e req-ab58dd59-7495-4eec-93fe-8b63ae69482b service nova] Creating event network-vif-plugged:611756c2-2e59-4286-aab5-5bb98b5b9133 for instance 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 on hv-cinder-83699 Apr 07 17:22:45.951561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-3d487081-d667-4135-98bc-21547ded012e req-ab58dd59-7495-4eec-93fe-8b63ae69482b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089813 Apr 07 17:22:45.954887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 169/323] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:22:46.246898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:46.263549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-08b75980-d907-47fd-b6cb-9f2ffcd99a28 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.393270 Apr 07 17:22:46.266460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 155/324] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:45 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:46.766323 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:46.766792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:46.786199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:46.787626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:46.792062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:46.792692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:46.960566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c449c2bb-d9f7-4aa2-b6df-df7df6a262af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Action: 'create', calling method: .version_select at 0x7ff9d06f3790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-546378509"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:22:46.982351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c449c2bb-d9f7-4aa2-b6df-df7df6a262af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Getting quotas for project f2cc28c058a54a7185d686c81dc0a3f1. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:22:46.988409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c449c2bb-d9f7-4aa2-b6df-df7df6a262af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Getting quotas for user ba927321673a4369a04500bee576f545 and project f2cc28c058a54a7185d686c81dc0a3f1. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:22:47.107192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:47.118543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4a80d921-2171-4b86-bf44-0b1bd9380740 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.353794 Apr 07 17:22:47.120498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 156/325] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:46 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:47.131302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:47.135005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:47.141982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:47.142747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:47.143755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:47.144461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:47.379749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:47.390646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:47.392352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:47.393869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2a737137-4da9-414e-94c0-a8dd9143c543 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.269146 Apr 07 17:22:47.397589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 157/326] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:47 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:47.410608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:47.411271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:47.418817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:47.419291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:47.420325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:47.420690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:47.440742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c449c2bb-d9f7-4aa2-b6df-df7df6a262af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Getting quotas for project f2cc28c058a54a7185d686c81dc0a3f1. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:22:47.445626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-c449c2bb-d9f7-4aa2-b6df-df7df6a262af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Getting quotas for user ba927321673a4369a04500bee576f545 and project f2cc28c058a54a7185d686c81dc0a3f1. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:22:47.493200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c449c2bb-d9f7-4aa2-b6df-df7df6a262af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.867323 Apr 07 17:22:47.493200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 170/327] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:22:46 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:47.714807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:47.728030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f578fcd9-8bc3-4d87-9092-a980550b410c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.327695 Apr 07 17:22:47.731505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 158/328] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:47 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:48.137205 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:48.137934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:48.145654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:48.149853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:48.151073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:48.155922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:48.394042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:48.394042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bb4db409-c5e3-4c1a-90cc-a2b6a627bca0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.251931 Apr 07 17:22:48.400398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 171/329] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:48 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:48.413784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:48.416464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:48.424397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:48.425277 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:48.426784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:48.427435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:48.671452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:48.681075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:48.683684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:48.685058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4bc9ffa0-56e5-4ee7-bc4f-17e65f62222d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.275679 Apr 07 17:22:48.686181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 159/330] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:48 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:48.749572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:48.754905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:48.768190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:48.768659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:48.772836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:48.773875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:49.024619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:49.041884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b8f3a7a1-a336-4369-9fa4-d339d0bd4180 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.297713 Apr 07 17:22:49.043114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 172/331] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:48 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:49.403461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:49.404363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:49.412219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:49.414966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:49.414966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:49.414966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:49.630554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:49.640393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-51cbee3e-8868-4a2b-b54f-6bb5fd92326e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.242420 Apr 07 17:22:49.641533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 160/332] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:49 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:49.709200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:49.711479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:49.725346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:49.727505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:49.730325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:49.735627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:50.003318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:50.017918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:50.019966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:50.028871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9e1d33d6-ff1b-4069-a37b-f06c0d006835 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.328799 Apr 07 17:22:50.030118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 173/333] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:49 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:50.067110 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:50.067972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:50.075505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:50.076198 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:50.077733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:50.078200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:50.375922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:50.385688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3429d57e-4881-4cad-ad55-b2f3c25ea06a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.322423 Apr 07 17:22:50.397471 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 161/334] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:50 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:50.661699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:50.662653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:50.680698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:50.686030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:50.688026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:50.688778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:50.975390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:50.985648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ce21ca30-108a-46de-9bce-95210eccda61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.330590 Apr 07 17:22:51.005460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 174/335] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:50 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:51.048019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:51.050197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:51.057097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:51.057915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:51.058918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:51.059913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:51.270537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:51.309589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:51.316600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:51.319439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8c382a9d-d9c9-44d1-838e-cb5cebeb7b73 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.273862 Apr 07 17:22:51.322459 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 162/336] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:51 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:51.404276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:51.405754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:51.412896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:51.413561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:51.414534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:51.415376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:51.568217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:51.585440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a42b9c54-4099-419e-9f97-d0266a04e157 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.185103 Apr 07 17:22:51.588430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 175/337] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:51 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:52.002916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:52.003516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:52.010524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:52.011129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:52.011722 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:52.012150 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:52.174361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:52.191641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ea7a24e3-de20-4c9c-839a-494e86421ae4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.192475 Apr 07 17:22:52.202702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 163/338] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:51 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:52.341551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:52.342104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:52.356882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:52.359347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:52.362442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:52.363310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:52.583816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:52.594230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:52.595782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:52.605975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ffd29c89-c48f-4a97-b75f-b112dd70d761 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.261640 Apr 07 17:22:52.607884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:52.608539 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:52.626888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 176/339] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:52 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:52.632985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:52.633890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:52.634860 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:52.635463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:52.832744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:52.841653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e470593e-7e1c-4916-ade2-b028a17bf977 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.240443 Apr 07 17:22:52.842223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 164/340] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:52 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:53.210257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:53.211426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:53.218963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:53.219671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:53.220719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:53.221471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:53.393189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:53.405637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-57428cba-6ea0-4c27-af8f-6544062d9604 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.199128 Apr 07 17:22:53.406298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 177/341] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:53 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:53.635491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:53.636131 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:53.644057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:53.645025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:53.645818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:53.646253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:53.812405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:53.821856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:53.823457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:53.824802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-afea569c-9a08-4517-817a-fea198775765 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.194359 Apr 07 17:22:53.825993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 165/342] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:53 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:53.864083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:53.865201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:53.872354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:53.872803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:53.876456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:53.876456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:54.027336 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:54.035469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-37e0f7b2-455c-45c7-aed3-65ac5c620a4f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.175445 Apr 07 17:22:54.036048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 178/343] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:53 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:54.424653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:54.425288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:54.431864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:54.432314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:54.433094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:54.433562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:54.595162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:54.603246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4ec1fd9a-40e1-4ca6-8c4e-33de87c97df8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.182248 Apr 07 17:22:54.604140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 166/344] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:54 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:54.844269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:54.844966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:54.852205 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:54.852962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:54.854029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:54.854679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:55.014436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:55.024524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:55.026131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:55.027292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0897d0a0-19fb-4db6-aa27-6f84cc7322b7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.187377 Apr 07 17:22:55.027849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 179/345] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:54 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:55.052918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:55.053574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:55.060972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:55.061450 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:55.062228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:55.062664 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:55.208307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:55.217393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-edad4192-2593-4bc7-a56e-5b6673a63afc tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.168354 Apr 07 17:22:55.218201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 167/346] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:55 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:55.620983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:55.621538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:55.627412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:55.627856 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:55.628637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:55.629067 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:55.764789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:55.772277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cf5e3f1a-d7eb-4d9b-96f4-341ea8e9c7c0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1319 microversion: 2.1 time: 0.155314 Apr 07 17:22:55.772842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 180/347] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:55 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:56.046919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:56.047523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:56.053510 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:56.054068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:56.055348 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:56.055784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:56.189665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:56.198961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:56.200706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:56.202251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4e7aed35-d431-4adc-9989-a5cc24f49a28 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.159156 Apr 07 17:22:56.202923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 168/348] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:56 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:56.235324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:56.235988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:56.243308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:56.244056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:56.244852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:56.245322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:56.412931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:56.427945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c192e475-cc1e-495e-8a0d-4afa9662eaf2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.196280 Apr 07 17:22:56.428552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 181/349] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:56 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:56.790028 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:56.790660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:56.796704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:56.797163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:56.797922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:56.798376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:56.939477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:56.947733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1cef00e1-1b05-48c2-90e9-986e68e3ee7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1507 microversion: 2.1 time: 0.161530 Apr 07 17:22:56.948257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 169/350] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:56 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:22:57.220669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:57.221221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:57.227681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:57.228135 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:57.228937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:57.229409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:57.451936 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:57.452543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:57.459128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:57.459658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:57.461083 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:57.461623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:57.483982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:57.493568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:57.495158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:57.496399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-94b064bd-0a3a-4ee2-bfea-8572d38f3040 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.279686 Apr 07 17:22:57.497065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 182/351] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:57 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:22:57.624477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:57.632496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e1b20e95-46e6-4882-8532-fd55a1770792 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.184357 Apr 07 17:22:57.633403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 170/352] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:57 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:58.517597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:58.518258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:58.524817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:58.525285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:58.526040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:58.526469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:58.656677 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:58.657323 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:58.664931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:58.665406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:58.666185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:58.666619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:58.676999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:58.687554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:58.691082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:58.693337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a26e2058-1377-42e8-a41d-96b21d0197f7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.179551 Apr 07 17:22:58.703462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 183/353] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:58 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:22:58.803100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:58.812073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6c651a05-6d2d-4920-befd-52153b425c21 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.159325 Apr 07 17:22:58.812633 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 171/354] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:58 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:22:59.713564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:59.714172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:59.720475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:59.720919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:59.721839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:59.722287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:59.829039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:22:59.830301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:22:59.837071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:59.837551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:59.838315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:22:59.838757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:22:59.862476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:59.870993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:59.872495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:22:59.873684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-48a576d2-12ff-4dc1-8469-9e3830d92ddd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.165208 Apr 07 17:22:59.874494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 184/355] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:22:59 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:00.196332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:00.204241 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-20e8a1fb-2b48-431d-9ebc-6cbfb00a762b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1723 microversion: 2.1 time: 0.379025 Apr 07 17:23:00.204802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 172/356] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:22:59 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:00.901048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:00.901701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:00.911167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:00.915277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:00.915277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:00.915277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:01.053492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:01.062952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:01.064455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:01.065637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6d588653-aa12-4060-9221-b704d645b078 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.169737 Apr 07 17:23:01.066212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 185/357] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:00 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:01.222144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:01.222776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:01.229963 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:01.230413 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:01.231304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:01.231749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:01.369356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:01.377652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4d6d6ed4-c7f3-4045-bf66-95f65348267e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1700 microversion: 2.1 time: 0.159397 Apr 07 17:23:01.378250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 173/358] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:01 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1700 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:01.394176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-26c6207e-2647-4a5a-848a-c79debaca1f6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:01.401126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26c6207e-2647-4a5a-848a-c79debaca1f6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:01.401596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26c6207e-2647-4a5a-848a-c79debaca1f6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:01.424545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-26c6207e-2647-4a5a-848a-c79debaca1f6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Going to try to start instance {{(pid=117703) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 07 17:23:01.597363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-26c6207e-2647-4a5a-848a-c79debaca1f6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.206699 Apr 07 17:23:01.597942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 186/359] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:23:01 2022] POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:23:01.607213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:01.607910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:01.614390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:01.614838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:01.619350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:01.619350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:01.762644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:01.779588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-71875b5b-8441-4b81-8f8c-df9966d9b909 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1709 microversion: 2.1 time: 0.177335 Apr 07 17:23:01.780169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 174/360] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:01 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:02.085019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:02.085739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:02.092158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:02.092613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:02.093428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:02.093872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:02.276972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:02.285320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:02.289626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:02.290856 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6fe153a8-95c8-4b85-9098-7f165c515c86 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.210080 Apr 07 17:23:02.292049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 187/361] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:02 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:02.797528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:02.798132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:02.804229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:02.804673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:02.806041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:02.806480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:02.953772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:02.962362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-78998afd-ea3a-4808-a61b-73e04556936a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1709 microversion: 2.1 time: 0.167915 Apr 07 17:23:02.962959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 175/362] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:02 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:03.311839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:03.312555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:03.318888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:03.319334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:03.320087 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:03.320516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:03.458891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:03.467129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:03.468613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:03.469821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6fb5c1bf-d677-43d1-b88d-0d5ae8a7c36a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.161844 Apr 07 17:23:03.470384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 188/363] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:03 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:03.980202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:03.980826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:03.989577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:03.990036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:03.990857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:03.991296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:04.131378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:04.139488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1ae8efd1-b28b-4da9-9565-3eb8bd40401e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1709 microversion: 2.1 time: 0.163687 Apr 07 17:23:04.140052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 176/364] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:03 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1709 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:04.488090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:04.488724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:04.495175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:04.495657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:04.496417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:04.496852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:04.634450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:04.645902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:04.645902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:04.646157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-18b5fce3-5915-4489-80ff-4647da63e3f1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.161832 Apr 07 17:23:04.646723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 189/365] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:04 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:05.161197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:05.161836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:05.167808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:05.168270 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:05.169330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:05.169767 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:05.313244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:05.321363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-828cfbf5-6759-4779-b5d9-e21d658f3e2b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1713 microversion: 2.1 time: 0.167778 Apr 07 17:23:05.337639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 177/366] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:05 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1713 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:05.666177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:05.667486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:05.674814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:05.675262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:05.676026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:05.676457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:05.812912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:05.821194 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:05.827143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:05.827143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-68fd15b2-a921-43f9-a8ae-b97b31d468a0 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.162327 Apr 07 17:23:05.827143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 190/367] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:05 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:06.843095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:06.843719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:06.850111 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:06.850616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:06.851423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:06.851858 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:06.994481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:07.004373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:07.005943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:07.007897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-97d272c6-bb73-4238-9c4d-f49c5af5e0d3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.167953 Apr 07 17:23:07.007897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 178/368] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:06 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:07.296424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-6d883647-d059-412d-a79e-153256655721 req-59da964f-887e-4483-be8e-b611c384f2e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff11525-d802-480e-8301-be7c4bc7746f", "name": "network-vif-plugged", "status": "completed", "tag": "bc998428-bafa-45c1-8d70-f3933c8b16ec"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:07.305048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-6d883647-d059-412d-a79e-153256655721 req-59da964f-887e-4483-be8e-b611c384f2e0 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:07.310022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-6d883647-d059-412d-a79e-153256655721 req-59da964f-887e-4483-be8e-b611c384f2e0 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:07.316517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-6d883647-d059-412d-a79e-153256655721 req-59da964f-887e-4483-be8e-b611c384f2e0 service nova] Creating event network-vif-plugged:bc998428-bafa-45c1-8d70-f3933c8b16ec for instance bff11525-d802-480e-8301-be7c4bc7746f on hv-cinder-83699 Apr 07 17:23:07.322307 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-6d883647-d059-412d-a79e-153256655721 req-59da964f-887e-4483-be8e-b611c384f2e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029449 Apr 07 17:23:07.322996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 191/369] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:08.027419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:08.027950 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:08.033876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:08.034321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:08.035112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:08.035545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:08.176106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:08.184863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:08.186381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:08.187515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c384c8eb-d2c3-475f-9b3e-425fe6caf5f3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.165189 Apr 07 17:23:08.188065 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 179/370] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:08 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:23:09.207468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:09.208144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:09.215064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:09.215504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:09.216258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:09.216689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:09.357564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:09.365754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:09.367238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:09.368377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8458b405-a8ef-48c2-a6ec-a8a4f1c6bd35 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.165751 Apr 07 17:23:09.368936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 192/371] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:09 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:10.388977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:10.389605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:10.395853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:10.396296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:10.401773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:10.401773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:10.537706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:10.547214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:10.548716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:10.549992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3a89216c-70f1-466c-ae36-81c4dbc42b31 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.166399 Apr 07 17:23:10.550734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 180/372] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:10 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:11.570142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:11.570737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:11.577369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:11.577830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:11.578607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:11.579045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:11.730771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:11.744493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:11.746204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:11.747440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1b51d80f-563c-4948-a74e-01577d57a55c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1810 microversion: 2.20 time: 0.181378 Apr 07 17:23:11.748008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 193/373] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:11 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:23:11.773652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-572814972", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-546378509", "security_groups": [{"name": "tempest-secgroup-smoke-426593493"}], "block_device_mapping_v2": [{"uuid": "7fdbe721-ada5-4f34-b4d4-088e766c4ee6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a10bd6e5-9aa1-4360-84f9-94e5bb245a82"}]}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:11.886539 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] validate_networks() for [('a10bd6e5-9aa1-4360-84f9-94e5bb245a82', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:23:12.287659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:23:12.288169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:23:12.288709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:23:12.289207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:23:12.289680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:23:12.300021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:12.300494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:12.301328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:12.301761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:12.318643 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Getting quotas for project f2cc28c058a54a7185d686c81dc0a3f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:23:12.322459 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Getting quotas for user ba927321673a4369a04500bee576f545 and project f2cc28c058a54a7185d686c81dc0a3f1. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:23:12.378917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:23:12.380978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fdbe721-ada5-4f34-b4d4-088e766c4ee6',volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:23:12.767147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c356eab5-b56d-4e9c-9e0f-a155aab6b73d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.997658 Apr 07 17:23:12.767931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 181/374] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:23:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:23:12.768230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:12.769110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:12.776820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:12.777303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:12.778077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:12.778509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:12.778717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f5bc4020-efb3-4030-9fe1-1b4dfa1b280c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:12.779512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f5bc4020-efb3-4030-9fe1-1b4dfa1b280c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:12.855339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f5bc4020-efb3-4030-9fe1-1b4dfa1b280c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:12.862498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f5bc4020-efb3-4030-9fe1-1b4dfa1b280c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1093 microversion: 2.1 time: 0.088499 Apr 07 17:23:12.863051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 182/375] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:12.941235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:12.949967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:12.951456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:12.952592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fbdfed76-bd45-48db-9ac7-6f5071651677 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1797 microversion: 2.20 time: 0.189738 Apr 07 17:23:12.953168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 194/376] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:23:12 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1797 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:23:13.879472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:13.880125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:13.886650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:13.887099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:13.887989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:13.888427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:13.947443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:13.954813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4a5a9cef-8932-4776-bab3-510b1a8c40d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1143 microversion: 2.1 time: 0.079272 Apr 07 17:23:13.955374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 183/377] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1143 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:14.017335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-99f4fbba-8b03-4c70-b88b-f42c028dede2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a29a31d3-0cf8-431a-9050-91e796fa495d"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:14.018633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-99f4fbba-8b03-4c70-b88b-f42c028dede2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:14.025413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f4fbba-8b03-4c70-b88b-f42c028dede2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:14.026460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f4fbba-8b03-4c70-b88b-f42c028dede2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:14.027349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f4fbba-8b03-4c70-b88b-f42c028dede2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:14.027816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f4fbba-8b03-4c70-b88b-f42c028dede2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:14.655441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-99f4fbba-8b03-4c70-b88b-f42c028dede2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.642003 Apr 07 17:23:14.656059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 195/378] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:23:14 2022] POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 194 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:14.972022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:14.973758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:14.981263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:14.981715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:14.987291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:14.987826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:15.088293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:15.096953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ee08ae7a-f9c6-4c5a-bde5-a75ecbeff0cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1199 microversion: 2.1 time: 0.129032 Apr 07 17:23:15.097872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 184/379] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1199 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:16.116265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:16.117074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:16.124227 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:16.124669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:16.125494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:16.125935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:16.373290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:16.380490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7f02f685-353b-47ce-85e8-66eb83e74b65 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1276 microversion: 2.1 time: 0.268887 Apr 07 17:23:16.381069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 196/380] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1276 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:16.810200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-8e5b0830-a0c1-4060-9962-01dba7ed5466 req-1fcabea4-26d6-45d9-84be-b36714b54bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29493f81-0b41-4e00-9b9a-08301cc1d2b0", "tag": "31cf2729-37f3-484c-bad0-abb9ba907dcd"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:16.816070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-8e5b0830-a0c1-4060-9962-01dba7ed5466 req-1fcabea4-26d6-45d9-84be-b36714b54bd1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:16.816524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-8e5b0830-a0c1-4060-9962-01dba7ed5466 req-1fcabea4-26d6-45d9-84be-b36714b54bd1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:16.841337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-8e5b0830-a0c1-4060-9962-01dba7ed5466 req-1fcabea4-26d6-45d9-84be-b36714b54bd1 service nova] Creating event network-changed:31cf2729-37f3-484c-bad0-abb9ba907dcd for instance 29493f81-0b41-4e00-9b9a-08301cc1d2b0 on hv-cinder-83699 Apr 07 17:23:16.846977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-8e5b0830-a0c1-4060-9962-01dba7ed5466 req-1fcabea4-26d6-45d9-84be-b36714b54bd1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046318 Apr 07 17:23:16.847670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 185/381] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:17.398577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:17.399141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:17.405920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:17.406234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:17.407012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:17.407449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:17.544230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f2422af0-c16c-432b-a5d9-f54288db7851 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69869d92-606e-4166-8462-2d8ae43d270c", "device": "/dev/sdb"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:17.545958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f2422af0-c16c-432b-a5d9-f54288db7851 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:17.552076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2422af0-c16c-432b-a5d9-f54288db7851 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:17.552526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2422af0-c16c-432b-a5d9-f54288db7851 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:17.553341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2422af0-c16c-432b-a5d9-f54288db7851 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:17.553764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2422af0-c16c-432b-a5d9-f54288db7851 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:17.620290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:17.628111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-81dae7f9-9180-4356-bd96-e1c5f37881a1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1276 microversion: 2.1 time: 0.233734 Apr 07 17:23:17.628943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 197/382] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1276 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:18.294264 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f2422af0-c16c-432b-a5d9-f54288db7851 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "POST /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754771 Apr 07 17:23:18.294926 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 186/383] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:23:17 2022] POST /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:23:18.645408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:18.646019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:18.652703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:18.653173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:18.654285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:18.654460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:18.790131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:18.797917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e5320982-e941-444d-8b4f-2c31c3c6d5b6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1276 microversion: 2.1 time: 0.156502 Apr 07 17:23:18.798480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 198/384] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:18 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:19.815399 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:19.816081 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:19.826009 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:19.826455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:19.827210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:19.827639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:19.959602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:19.966895 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-216e3989-d84a-48c5-82ca-1a0597dd025e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1276 microversion: 2.1 time: 0.156100 Apr 07 17:23:19.967508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 187/385] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:20.983645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:20.984184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:20.990569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:20.991099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:20.991869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:20.992311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:21.129408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:21.136565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a735489d-c526-4a55-9813-252022fc73a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1276 microversion: 2.1 time: 0.156910 Apr 07 17:23:21.137117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 199/386] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:22.155054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:22.155667 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:22.158721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:22.159717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:22.162268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:22.168656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:22.168656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:22.168656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:22.169688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:22.169688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:22.169688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:22.169688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:22.191543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lazy-loading 'flavor' on Instance uuid 3966d8bc-6664-4582-a275-e7dcfbcba3cc {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:23:22.300618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:22.307999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-998fd97a-4666-4eaa-a443-ec49349118d4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1276 microversion: 2.1 time: 0.157732 Apr 07 17:23:22.308497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 188/387] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:22.501121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8c1d6bd4-7f11-484a-86f1-18ef221a8752 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/action" status: 200 len: 32 microversion: 2.1 time: 0.347225 Apr 07 17:23:22.501755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 200/388] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:23:22 2022] POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/action => generated 32 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 07 17:23:22.513813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:22.514459 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:22.520217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:22.520663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:22.521454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:22.521888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:22.690210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:22.698528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cd760b51-586a-4509-b2bd-c69d1961067a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.190693 Apr 07 17:23:22.699119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 189/389] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:23.324778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:23.325509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:23.332256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:23.332704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:23.333493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:23.333937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:23.534193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:23.539513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c1b0889f-b5ce-46df-a91d-47418605c833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.219505 Apr 07 17:23:23.540074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 201/390] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:23.715777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:23.716386 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:23.723098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:23.723548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:23.724317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:23.724755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:23.852370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:23.860603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-641b7832-8d9f-431b-95f3-4f4fc1f04faf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.148621 Apr 07 17:23:23.861175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 190/391] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:24.557267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:24.557874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:24.564937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:24.566867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:24.566867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:24.566867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:24.711915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:24.719115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d4d71224-ba04-4e8f-b2dc-e5272adb5227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.165703 Apr 07 17:23:24.719678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 202/392] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:24.879168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:24.879780 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:24.885807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:24.886256 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:24.887026 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:24.887480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:25.019997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:25.027952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bdda12cb-d54a-4675-a719-fcd70f485040 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.153923 Apr 07 17:23:25.028513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 191/393] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:25.735652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:25.736302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:25.742694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:25.743145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:25.743914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:25.744351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:25.881980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:25.889317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-86007084-7560-47a8-a964-34610796081a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.157598 Apr 07 17:23:25.890534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 203/394] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:26.045416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:26.046024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:26.052306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:26.052753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:26.053540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:26.053974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:26.186054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:26.194469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-48141324-4794-442a-a9c5-002547ff36d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.152827 Apr 07 17:23:26.195033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 192/395] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:26.907675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:26.908210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:26.914478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:26.914926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:26.915704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:26.916132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:27.056214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:27.063621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1e8170c4-c992-4711-9ad1-ff0d1c881550 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.160563 Apr 07 17:23:27.064183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 204/396] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:27.212540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:27.213167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:27.220253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:27.220720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:27.221533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:27.221965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:27.349938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:27.357774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ae8e0eaf-de2d-4afa-990f-09b0a130fb93 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.149220 Apr 07 17:23:27.358496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 193/397] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:28.079796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:28.080423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:28.086657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:28.087105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:28.087857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:28.088288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:28.219908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:28.227108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4bacfc90-4cce-48d8-ac05-6b8c6d0cab17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.151650 Apr 07 17:23:28.227670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 205/398] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:28.374789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:28.375327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:28.381511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:28.381951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:28.382702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:28.383131 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:28.517703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:28.525619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-61cd85b0-4c4b-4492-99b3-0592bdd9fe49 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.154648 Apr 07 17:23:28.526177 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 194/399] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:29.243707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:29.244314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:29.250668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:29.251121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:29.251881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:29.252314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:29.385099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:29.393062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-55028275-c7ac-4764-afc3-05f64cfc3dda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.153155 Apr 07 17:23:29.393648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 206/400] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:29 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:29.542852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:29.543388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:29.549844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:29.550294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:29.551061 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:29.551495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:29.688636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:29.696605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-18a970df-3820-4f33-82d1-ca0f9e465dc3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.157895 Apr 07 17:23:29.697187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 195/401] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:30.409754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:30.410358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:30.416577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:30.417032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:30.417837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:30.418276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:30.552356 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:30.559772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b801ed2e-2275-40bd-a335-cc9dd124fb18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.153861 Apr 07 17:23:30.560345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 207/402] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:30.714673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:30.715278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:30.722204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:30.722732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:30.723558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:30.724068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:30.861205 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:30.869349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5d10a65b-37a9-4e23-beb2-b18c7fcc8a5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.158927 Apr 07 17:23:30.870031 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 196/403] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:31.577783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:31.578418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:31.584707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:31.585180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:31.585957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:31.586394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:31.727882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:31.735117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-321c3d54-a762-47c6-83ec-9acdfed9b8c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.161983 Apr 07 17:23:31.735673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 208/404] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:31.896844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:31.896844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:31.896844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:31.896844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:31.898054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:31.898054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:32.027025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:32.035049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ec342797-e2ed-488a-848c-086a221823f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.150908 Apr 07 17:23:32.035615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 197/405] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:32.751510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:32.752116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:32.758755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:32.759208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:32.760322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:32.760759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:32.895658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:32.903273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-06476335-85a3-45d2-ad77-40bbcbfd3454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.156267 Apr 07 17:23:32.903823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 209/406] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:32 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:33.052269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:33.052880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:33.059166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:33.059612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:33.060371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:33.060805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:33.192725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:33.200560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-85e4235f-05cd-474e-bf9a-928355a0f121 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.152053 Apr 07 17:23:33.201122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 198/407] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:33.919985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:33.921131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:33.927467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:33.927988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:33.928756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:33.929213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:34.070316 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:34.079451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ff90ca86-9dfd-423c-8fc8-8ed457d56b81 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.163440 Apr 07 17:23:34.080021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 210/408] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:34.217711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:34.218315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:34.224550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:34.225062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:34.225844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:34.226280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:34.361029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:34.369109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bdbb7496-70e1-4bd2-afd8-220369225ba7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.155174 Apr 07 17:23:34.369696 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 199/409] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:35.096494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:35.097095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:35.103346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:35.103788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:35.104545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:35.104985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:35.237769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:35.245340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ce62ba44-b47a-460b-b818-ceaeee99f687 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.153471 Apr 07 17:23:35.245905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 211/410] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:35.387330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:35.389692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:35.395129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:35.395716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:35.396525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:35.396964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:35.535237 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:35.543064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fabb7b60-47c0-433c-8826-1cf869e507ae tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.159676 Apr 07 17:23:35.543639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 200/411] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:35.590974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-2b6ac994-be5b-46d8-86aa-7a84bd41bd0b req-1adfe032-26ac-4ebc-9f3d-c737b06594e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29493f81-0b41-4e00-9b9a-08301cc1d2b0", "name": "network-vif-plugged", "status": "completed", "tag": "31cf2729-37f3-484c-bad0-abb9ba907dcd"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:35.599542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-2b6ac994-be5b-46d8-86aa-7a84bd41bd0b req-1adfe032-26ac-4ebc-9f3d-c737b06594e0 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:35.599991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-2b6ac994-be5b-46d8-86aa-7a84bd41bd0b req-1adfe032-26ac-4ebc-9f3d-c737b06594e0 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:35.611095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-2b6ac994-be5b-46d8-86aa-7a84bd41bd0b req-1adfe032-26ac-4ebc-9f3d-c737b06594e0 service nova] Creating event network-vif-plugged:31cf2729-37f3-484c-bad0-abb9ba907dcd for instance 29493f81-0b41-4e00-9b9a-08301cc1d2b0 on hv-cinder-83699 Apr 07 17:23:35.616049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-2b6ac994-be5b-46d8-86aa-7a84bd41bd0b req-1adfe032-26ac-4ebc-9f3d-c737b06594e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028798 Apr 07 17:23:35.616620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 212/412] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:36.262162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:36.262764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:36.269790 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:36.270247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:36.271007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:36.271442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:36.403466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:36.411081 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-38d6a422-4ea6-45fc-b42b-2efa3e39f88e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.152687 Apr 07 17:23:36.411638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 201/413] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:36.563304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:36.563909 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:36.570165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:36.570613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:36.571374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:36.571807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:36.709045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:36.717094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-79eae215-c80c-4429-8e1d-b88777410dca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.159206 Apr 07 17:23:36.717737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 213/414] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:37.427770 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:37.428378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:37.434858 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:37.435302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:37.436208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:37.436638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:37.571747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:37.579854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8d733d8c-7d8a-4f9c-88ff-516680dfdadc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.155840 Apr 07 17:23:37.580427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 202/415] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:37.734748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:37.735287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:37.741693 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:37.742145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:37.742913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:37.743352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:37.871155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:37.879540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b993d254-976a-4228-b0b1-c7658a9a3013 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.148767 Apr 07 17:23:37.880113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 214/416] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:38.597190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:38.597734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:38.603945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:38.604388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:38.605157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:38.605586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:38.742812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:38.750706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5f06e9da-3a74-4cad-bda3-e5c6e7dec19b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.158128 Apr 07 17:23:38.751268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 203/417] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:38.897060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:38.897915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:38.904183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:38.904662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:38.905473 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:38.906725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:39.042521 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:39.050312 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e3d9e882-9564-4e4d-bc97-fe30ebfd3920 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.157306 Apr 07 17:23:39.050967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 215/418] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:39.767443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:39.768052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:39.774638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:39.775109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:39.775871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:39.776304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:39.908690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:39.916199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5d2f5085-9b33-4c25-970b-02734b9a68db tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1264 microversion: 2.1 time: 0.152872 Apr 07 17:23:39.922028 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 204/419] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:40.067947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:40.068569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:40.075010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:40.075466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:40.076235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:40.076676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:40.209427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:40.217264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-75ab0764-88da-471c-a1ba-ff6079d7d7d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.153256 Apr 07 17:23:40.217836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 216/420] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:40.934087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:40.934710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:40.941794 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:40.942245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:40.943014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:40.943453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:41.077073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:41.085443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-21c61f81-79ec-4efc-a143-36ad268c18ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1451 microversion: 2.1 time: 0.155244 Apr 07 17:23:41.085995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 205/421] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:41.102631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:41.103240 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:41.109534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:41.109980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:41.110761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:41.111200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:41.234959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:41.235567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:41.241468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:41.241919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:41.242054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:41.242697 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:41.243134 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:41.249500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ccaee732-34e3-4aee-a9ea-a0a1a61b63fd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1451 microversion: 2.1 time: 0.150708 Apr 07 17:23:41.250099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 217/422] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:41.399797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:41.408318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fc3819d5-eb28-471b-b406-b84fd66e83cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.176502 Apr 07 17:23:41.408885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 206/423] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:42.426955 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:42.427563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:42.433830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:42.434275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:42.435046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:42.435481 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:42.666133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:42.674821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ceb43d8a-5957-4c58-ab7a-795f18eac5df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.252536 Apr 07 17:23:42.675770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 218/424] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:42.744647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:42.745162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:42.752435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:42.752876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:42.753672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:42.754106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:42.881472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'services' on Instance uuid 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:23:43.096536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-66ab9894-7d0d-46bc-8a33-4782b6bd4ea6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0/os-volume_attachments/69869d92-606e-4166-8462-2d8ae43d270c" status: 202 len: 0 microversion: 2.1 time: 0.355526 Apr 07 17:23:43.097057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 207/425] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:23:42 2022] DELETE /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0/os-volume_attachments/69869d92-606e-4166-8462-2d8ae43d270c => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:23:43.532122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-aa86887b-3c7a-4eb7-bb91-aeeb847d72f4 req-1a049b76-ca32-4598-af4b-665a975cf32d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29493f81-0b41-4e00-9b9a-08301cc1d2b0", "tag": "31cf2729-37f3-484c-bad0-abb9ba907dcd"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:43.538476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-aa86887b-3c7a-4eb7-bb91-aeeb847d72f4 req-1a049b76-ca32-4598-af4b-665a975cf32d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:43.542409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-aa86887b-3c7a-4eb7-bb91-aeeb847d72f4 req-1a049b76-ca32-4598-af4b-665a975cf32d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:43.549572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-aa86887b-3c7a-4eb7-bb91-aeeb847d72f4 req-1a049b76-ca32-4598-af4b-665a975cf32d service nova] Creating event network-changed:31cf2729-37f3-484c-bad0-abb9ba907dcd for instance 29493f81-0b41-4e00-9b9a-08301cc1d2b0 on hv-cinder-83699 Apr 07 17:23:43.554598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-aa86887b-3c7a-4eb7-bb91-aeeb847d72f4 req-1a049b76-ca32-4598-af4b-665a975cf32d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030139 Apr 07 17:23:43.555203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 219/426] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:43.696979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:43.697804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:43.706628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:43.707166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:43.708784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:43.709378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:43.892487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:43.901018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0fcc99c0-a35b-43d0-aff8-f62d6d7eda76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.210263 Apr 07 17:23:43.901623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 208/427] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:44.920451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:44.921161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:44.927996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:44.933470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:44.933470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:44.933470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:45.070560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:45.078370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9ce76eb9-f79c-453b-9bb2-64df2533fbb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.162616 Apr 07 17:23:45.078952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 220/428] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:45.263115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:45.263685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:45.270658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:45.271338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:45.272282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:45.273129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:45.302208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:23:45.610203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-10ee4b37-5279-407d-a3c5-e8f909281010 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 204 len: 0 microversion: 2.1 time: 0.350604 Apr 07 17:23:45.611033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 209/429] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:23:45 2022] DELETE /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:23:45.618970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:45.619572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:45.625479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:45.625942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:45.626755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:45.627183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:45.760200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:45.768544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-32f3c579-6c1a-4397-b2ca-0529762e3e65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1513 microversion: 2.1 time: 0.153293 Apr 07 17:23:45.769403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 221/430] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:45 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:46.097187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:46.097797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:46.103603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:46.104045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:46.104833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:46.105282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:46.248000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:46.256529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-84bec1af-582f-45e5-8b94-f07076ac21e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.164571 Apr 07 17:23:46.257090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 210/431] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:46.786863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:46.787438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:46.793820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:46.794266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:46.795026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:46.795460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:46.930643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:46.937990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-450e0009-a06b-427a-93ec-c5190025bc52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1513 microversion: 2.1 time: 0.155728 Apr 07 17:23:46.938634 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 222/432] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:46 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:47.274017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:47.274614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:47.280865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:47.281342 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:47.282153 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:47.282593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:47.417483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:47.425850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e75ccba0-d425-4ba0-a90b-9fc9f443ab16 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.155987 Apr 07 17:23:47.426404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 211/433] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:47.955981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:47.956586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:47.962933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:47.963376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:47.964133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:47.964563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:48.096470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:48.104031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a6294fc2-7268-47ec-ba30-0060ac6623a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1513 microversion: 2.1 time: 0.152792 Apr 07 17:23:48.104583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 223/434] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:47 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:48.443057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:48.443692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:48.449872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:48.450312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:48.451055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:48.451482 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:48.582799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:48.590706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8c0f3fa7-b3a2-49f3-b692-7d09e83f1fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1716 microversion: 2.1 time: 0.151622 Apr 07 17:23:48.596582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 212/435] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:48.698917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:48.699340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:48.705891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:48.706335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:48.707099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:48.707714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:48.829965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] HTTP exception thrown: Cannot 'detach_volume' instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc while it is in vm_state rescued Apr 07 17:23:48.830572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Returning 409 to user: Cannot 'detach_volume' instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc while it is in vm_state rescued {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:23:48.831413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2d17ab3c-ef65-4710-a258-d5d8ab191afd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments/a29a31d3-0cf8-431a-9050-91e796fa495d" status: 409 len: 152 microversion: 2.1 time: 0.136646 Apr 07 17:23:48.831974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 224/436] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:23:48 2022] DELETE /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments/a29a31d3-0cf8-431a-9050-91e796fa495d => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 07 17:23:48.840314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-770f3288-3b15-40a6-8c11-2130acc7c4c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:48.840908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-770f3288-3b15-40a6-8c11-2130acc7c4c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:48.847311 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-770f3288-3b15-40a6-8c11-2130acc7c4c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:48.847762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-770f3288-3b15-40a6-8c11-2130acc7c4c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:48.848534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-770f3288-3b15-40a6-8c11-2130acc7c4c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:48.848981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-770f3288-3b15-40a6-8c11-2130acc7c4c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:49.025517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-770f3288-3b15-40a6-8c11-2130acc7c4c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/action" status: 202 len: 0 microversion: 2.1 time: 0.188681 Apr 07 17:23:49.026058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 213/437] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:23:48 2022] POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:23:49.034122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:49.034742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:49.042337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:49.044349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:49.044349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:49.044349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:49.122542 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:49.123250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:49.140357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:49.140796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:49.142264 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:49.143335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:49.250203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:49.258986 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-85f92b5e-a4e0-43a3-86dd-2542dc2c08ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1471 microversion: 2.1 time: 0.140413 Apr 07 17:23:49.259859 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 214/438] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:49 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1471 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:49.274568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-ce206fcb-1dd7-4eb3-92ba-4d4df5481aec req-928e21d1-102f-4fde-9fa6-2e72e15623bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4797990b-2d5a-44f8-a9bd-b96d6919d4f0", "name": "network-vif-deleted", "tag": "611756c2-2e59-4286-aab5-5bb98b5b9133"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:49.284731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-ce206fcb-1dd7-4eb3-92ba-4d4df5481aec req-928e21d1-102f-4fde-9fa6-2e72e15623bc service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:49.285200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-ce206fcb-1dd7-4eb3-92ba-4d4df5481aec req-928e21d1-102f-4fde-9fa6-2e72e15623bc service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:49.286586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:49.298680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-ce206fcb-1dd7-4eb3-92ba-4d4df5481aec req-928e21d1-102f-4fde-9fa6-2e72e15623bc service nova] Creating event network-vif-deleted:611756c2-2e59-4286-aab5-5bb98b5b9133 for instance 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 on hv-cinder-83699 Apr 07 17:23:49.300624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dafdf73e-9a5a-4dba-9894-9ed170056e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1724 microversion: 2.1 time: 0.270298 Apr 07 17:23:49.310749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 225/439] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:49.311291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-ce206fcb-1dd7-4eb3-92ba-4d4df5481aec req-928e21d1-102f-4fde-9fa6-2e72e15623bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033584 Apr 07 17:23:49.311291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 215/440] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:23:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:50.277184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:50.277731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:50.284139 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:50.284593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:50.285403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:50.285848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:50.317753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:50.318206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:50.318657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'fault' on Instance uuid 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:23:50.320363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:50.321048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:50.327013 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:50.327461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:50.328211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:50.328638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:50.368742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:50.377003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c849956f-066e-4077-825c-1da897bfe5f6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1309 microversion: 2.1 time: 0.103948 Apr 07 17:23:50.377701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 226/441] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:50 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:50.466476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:50.474795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-72b7d310-c71d-4b0f-bd71-7e2d318a9af4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1724 microversion: 2.1 time: 0.159038 Apr 07 17:23:50.475360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 216/442] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:51.395322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:51.396656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:51.403416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:51.403855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:51.404811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:51.405267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:51.435824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:51.436263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:51.436705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'fault' on Instance uuid 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:23:51.482198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:51.490374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b39910dd-677c-41f9-99b2-96c4ce41932f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 200 len: 1309 microversion: 2.1 time: 0.099935 Apr 07 17:23:51.490943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 227/443] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:51 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:51.492410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:51.493175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:51.500465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:51.501926 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:51.502948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:51.503650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:51.639262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:51.647221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e5f738a4-9efc-4392-b05b-93b54f014f7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1724 microversion: 2.1 time: 0.158863 Apr 07 17:23:51.647992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 217/444] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:52.507980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:52.508511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: 4797990b-2d5a-44f8-a9bd-b96d6919d4f0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:52.514835 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:52.515283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:52.516069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:52.516505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:52.529502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] HTTP exception thrown: Instance 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 could not be found. Apr 07 17:23:52.530079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Returning 404 to user: Instance 4797990b-2d5a-44f8-a9bd-b96d6919d4f0 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:23:52.530889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c671bc10-b75b-49e4-b5b3-9d86a031e068 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0" status: 404 len: 111 microversion: 2.1 time: 0.026877 Apr 07 17:23:52.531399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 228/445] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:52 2022] GET /compute/v2.1/servers/4797990b-2d5a-44f8-a9bd-b96d6919d4f0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:23:52.669462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:52.670080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:52.678983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:52.679442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:52.680218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:52.680651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:52.831358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:52.839400 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-79dbe5ef-2cd9-462a-82b9-f1f42efba4b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1730 microversion: 2.1 time: 0.173852 Apr 07 17:23:52.839968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 218/446] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:23:52.856706 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c7c42d38-6e81-4e39-bfc6-e3036fede352 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:52.859328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c7c42d38-6e81-4e39-bfc6-e3036fede352 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:52.864416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7c42d38-6e81-4e39-bfc6-e3036fede352 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:52.864924 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7c42d38-6e81-4e39-bfc6-e3036fede352 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:52.865682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7c42d38-6e81-4e39-bfc6-e3036fede352 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:52.866279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7c42d38-6e81-4e39-bfc6-e3036fede352 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:52.956905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c7c42d38-6e81-4e39-bfc6-e3036fede352 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104219 Apr 07 17:23:52.957558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 229/447] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Apr 7 17:23:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:54.180797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-a7131f8f-713f-475b-84b5-62db0ba4a1ed req-49e59500-5700-48c5-aeb5-af188fa38d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3966d8bc-6664-4582-a275-e7dcfbcba3cc", "tag": "47442b13-f258-4d3e-a668-6710428db8ce"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:54.201688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-a7131f8f-713f-475b-84b5-62db0ba4a1ed req-49e59500-5700-48c5-aeb5-af188fa38d29 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:54.202134 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-a7131f8f-713f-475b-84b5-62db0ba4a1ed req-49e59500-5700-48c5-aeb5-af188fa38d29 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:54.217198 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-a7131f8f-713f-475b-84b5-62db0ba4a1ed req-49e59500-5700-48c5-aeb5-af188fa38d29 service nova] Creating event network-changed:47442b13-f258-4d3e-a668-6710428db8ce for instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc on hv-cinder-83699 Apr 07 17:23:54.223636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-a7131f8f-713f-475b-84b5-62db0ba4a1ed req-49e59500-5700-48c5-aeb5-af188fa38d29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046518 Apr 07 17:23:54.224481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 219/448] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:56.239166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-4e7f90da-9f6b-4bd1-be5e-abbd2c026a07 req-305bd7e5-f2a9-4e6c-8998-5b0551281c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3966d8bc-6664-4582-a275-e7dcfbcba3cc", "tag": "47442b13-f258-4d3e-a668-6710428db8ce"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:56.247033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-4e7f90da-9f6b-4bd1-be5e-abbd2c026a07 req-305bd7e5-f2a9-4e6c-8998-5b0551281c0e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:56.247476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-4e7f90da-9f6b-4bd1-be5e-abbd2c026a07 req-305bd7e5-f2a9-4e6c-8998-5b0551281c0e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:56.258784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-4e7f90da-9f6b-4bd1-be5e-abbd2c026a07 req-305bd7e5-f2a9-4e6c-8998-5b0551281c0e service nova] Creating event network-changed:47442b13-f258-4d3e-a668-6710428db8ce for instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc on hv-cinder-83699 Apr 07 17:23:56.263785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-4e7f90da-9f6b-4bd1-be5e-abbd2c026a07 req-305bd7e5-f2a9-4e6c-8998-5b0551281c0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029300 Apr 07 17:23:56.264433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 230/449] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:23:56.689199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:56.690466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:56.699100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:56.699791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:56.700570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:56.701178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:56.780748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lazy-loading 'services' on Instance uuid c48aed11-0395-43fe-8a15-18ec4fc83ae2 {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:23:56.946660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2851be35-56e1-4a30-b1a0-cfbfea7965a1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-volume_attachments/ea6a3bff-f6d7-4252-9883-4237c1748612" status: 202 len: 0 microversion: 2.1 time: 0.263133 Apr 07 17:23:56.947416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 220/450] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:23:56 2022] DELETE /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-volume_attachments/ea6a3bff-f6d7-4252-9883-4237c1748612 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:23:58.057164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-01e4815a-cf16-404e-b1d2-3fa403199c2f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:23:58.064199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-01e4815a-cf16-404e-b1d2-3fa403199c2f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:58.064655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-01e4815a-cf16-404e-b1d2-3fa403199c2f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:58.086196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-01e4815a-cf16-404e-b1d2-3fa403199c2f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Going to try to stop instance {{(pid=117703) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 07 17:23:58.208189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-01e4815a-cf16-404e-b1d2-3fa403199c2f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.155656 Apr 07 17:23:58.208814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 231/451] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:23:58 2022] POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:23:58.217959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:58.218681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:58.224684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:58.227132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:58.227132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:58.227132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:58.362326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:58.369705 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6c2b6a1a-b8a9-47b2-bbc8-a5692d156b5b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.156502 Apr 07 17:23:58.371328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 221/452] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:58 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:23:59.388075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:23:59.388769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:23:59.395808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:59.396255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:59.397010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:23:59.397475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:23:59.528809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:23:59.537081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7c3d59d4-d262-4df9-b7c8-1251c323d2e9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.153178 Apr 07 17:23:59.537668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 232/453] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:23:59 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:00.554673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:00.555280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:00.561627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:00.562079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:00.562841 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:00.563308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:00.696506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:00.703718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c86b160b-a393-40b0-adae-73d8402d703e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.152865 Apr 07 17:24:00.704873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 222/454] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:00 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:01.721704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:01.722310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:01.728112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:01.728562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:01.729372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:01.729812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:01.864031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:01.871422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-61787d03-786e-408d-9a57-cd629ab3f2e3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.154071 Apr 07 17:24:01.871992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 233/455] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:01 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:02.889087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:02.889820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:02.896175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:02.896625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:02.897415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:02.898116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:02.917488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1950687586", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "networks": [{"uuid": "98029ca3-40af-49f8-8ff3-47599a1cc35d"}]}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:02.970724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] validate_networks() for [('98029ca3-40af-49f8-8ff3-47599a1cc35d', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:24:03.101483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:03.108850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-797e25f4-1321-4dc1-99e2-a4b7d5ef4fa0 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.223524 Apr 07 17:24:03.109455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 223/456] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:02 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:03.352069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:24:03.352492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:24:03.352964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:24:03.353400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:24:03.353812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:24:03.363595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:03.364061 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:03.364845 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:03.365308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:03.381882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Getting quotas for project 81110c4ea45c46a88291fe2527aabd46. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:24:03.385797 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Getting quotas for user 1e941f28846a4bd8ab78dfbdaf7115e2 and project 81110c4ea45c46a88291fe2527aabd46. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:24:03.396591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:24:03.399244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:24:03.513798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-842a7cc8-6129-4a63-b769-0eaf0cb39b7e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600055 Apr 07 17:24:03.514375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 234/457] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 07 17:24:03.525019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-938b25d8-c1c1-43be-aa28-181b56e0eb89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:03.525704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-938b25d8-c1c1-43be-aa28-181b56e0eb89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:03.577056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-938b25d8-c1c1-43be-aa28-181b56e0eb89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:03.584617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-938b25d8-c1c1-43be-aa28-181b56e0eb89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1219 microversion: 2.1 time: 0.063611 Apr 07 17:24:03.585331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 224/458] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:03 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:04.127238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:04.127851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:04.135666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.136119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.136886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.137369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.270992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:04.278503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b17371f4-f6e6-4e9d-901b-daadf2a6ec10 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.156162 Apr 07 17:24:04.280759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 235/459] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:04 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:04.602879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:04.603550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:04.609536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.609896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.611856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.612293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.661972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b4992e28-eac2-4d93-ab3e-4a1c1fabd8dc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:04.662702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b4992e28-eac2-4d93-ab3e-4a1c1fabd8dc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:04.669748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4992e28-eac2-4d93-ab3e-4a1c1fabd8dc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.670430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4992e28-eac2-4d93-ab3e-4a1c1fabd8dc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.671381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4992e28-eac2-4d93-ab3e-4a1c1fabd8dc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.671974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4992e28-eac2-4d93-ab3e-4a1c1fabd8dc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.678358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:04.685622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f28f9ec9-c82e-4211-8139-af9ff4bfcf05 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1215 microversion: 2.1 time: 0.086726 Apr 07 17:24:04.696215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 225/460] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:04 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1215 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:04.702516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b4992e28-eac2-4d93-ab3e-4a1c1fabd8dc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments/554435eb-d0dc-417e-9472-fa0a1a7e7f4e" status: 200 len: 194 microversion: 2.20 time: 0.045159 Apr 07 17:24:04.703098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 236/461] 10.222.0.26 () {60 vars in 1453 bytes} [Thu Apr 7 17:24:04 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments/554435eb-d0dc-417e-9472-fa0a1a7e7f4e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 17:24:04.765583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:04.766000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:04.771861 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.772330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.773433 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:04.773873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:04.853974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lazy-loading 'services' on Instance uuid bff11525-d802-480e-8301-be7c4bc7746f {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:24:05.078258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-72ff519a-c679-47d6-8ab4-5b8e99839859 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments/554435eb-d0dc-417e-9472-fa0a1a7e7f4e" status: 202 len: 0 microversion: 2.20 time: 0.316426 Apr 07 17:24:05.079307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 226/462] 10.222.0.26 () {60 vars in 1456 bytes} [Thu Apr 7 17:24:04 2022] DELETE /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments/554435eb-d0dc-417e-9472-fa0a1a7e7f4e => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 07 17:24:05.088278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7db716fb-d250-4705-915f-0583971b76ef tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:05.089359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7db716fb-d250-4705-915f-0583971b76ef tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:05.095962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db716fb-d250-4705-915f-0583971b76ef tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:05.096405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db716fb-d250-4705-915f-0583971b76ef tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:05.097188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db716fb-d250-4705-915f-0583971b76ef tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:05.097625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db716fb-d250-4705-915f-0583971b76ef tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:05.127565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7db716fb-d250-4705-915f-0583971b76ef tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043169 Apr 07 17:24:05.128200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 237/463] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Apr 7 17:24:05 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:24:05.296393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:05.297191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:05.303990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:05.304435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:05.305217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:05.305648 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:05.437353 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:05.444751 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6be01e23-ebb5-4a48-8319-826c71e24e6f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.152755 Apr 07 17:24:05.445333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 227/464] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:05 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:05.707786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:05.708397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:05.715637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:05.722501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:05.722501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:05.722501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:05.779036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:05.786663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0b67144a-aa1c-447a-8674-228c903992c7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1279 microversion: 2.1 time: 0.082719 Apr 07 17:24:05.787236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 238/465] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:05 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:06.139432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6ae03edc-b029-4bd1-b8c1-19f9e42d355a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:06.140423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6ae03edc-b029-4bd1-b8c1-19f9e42d355a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:06.146856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae03edc-b029-4bd1-b8c1-19f9e42d355a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:06.147306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae03edc-b029-4bd1-b8c1-19f9e42d355a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:06.148345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae03edc-b029-4bd1-b8c1-19f9e42d355a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:06.148777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae03edc-b029-4bd1-b8c1-19f9e42d355a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:06.179295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6ae03edc-b029-4bd1-b8c1-19f9e42d355a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043797 Apr 07 17:24:06.180261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 228/466] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Apr 7 17:24:06 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 07 17:24:06.462177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:06.462728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:06.468902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:06.470050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:06.471400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:06.471837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:06.610300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:06.618073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-95b80880-7674-49b8-a429-aaac6a407255 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.159694 Apr 07 17:24:06.618663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 239/467] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:06 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:06.804415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:06.805050 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:06.810753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:06.811206 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:06.811968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:06.812403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:06.944997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:06.952298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8d1704d6-ff53-4737-ba51-ebce83fe8d96 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.151771 Apr 07 17:24:06.953701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 229/468] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:06 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:07.191204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-22cede22-7f4f-4356-aa26-afb82650b856 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:07.192227 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-22cede22-7f4f-4356-aa26-afb82650b856 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:07.198094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cede22-7f4f-4356-aa26-afb82650b856 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.198611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cede22-7f4f-4356-aa26-afb82650b856 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.199392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cede22-7f4f-4356-aa26-afb82650b856 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.199831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cede22-7f4f-4356-aa26-afb82650b856 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.229326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-22cede22-7f4f-4356-aa26-afb82650b856 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042167 Apr 07 17:24:07.229896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 240/469] 10.222.0.26 () {60 vars in 1342 bytes} [Thu Apr 7 17:24:07 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:07.289379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:07.289935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:07.296410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.296857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.298787 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.299226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.323848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:24:07.493199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-dc634ba2-2e52-4c53-9b76-09dc8a9fd83c req-5780726f-1eef-4f0f-9b67-e97532a9bb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3", "tag": "460f0c0e-20d7-48e1-b7d2-e771eec9c91c"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:07.504628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-dc634ba2-2e52-4c53-9b76-09dc8a9fd83c req-5780726f-1eef-4f0f-9b67-e97532a9bb39 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.505068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-dc634ba2-2e52-4c53-9b76-09dc8a9fd83c req-5780726f-1eef-4f0f-9b67-e97532a9bb39 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.516963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-dc634ba2-2e52-4c53-9b76-09dc8a9fd83c req-5780726f-1eef-4f0f-9b67-e97532a9bb39 service nova] Creating event network-changed:460f0c0e-20d7-48e1-b7d2-e771eec9c91c for instance fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 on hv-cinder-83699 Apr 07 17:24:07.521988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-dc634ba2-2e52-4c53-9b76-09dc8a9fd83c req-5780726f-1eef-4f0f-9b67-e97532a9bb39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032552 Apr 07 17:24:07.523153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 241/470] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:24:07.637567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:07.638857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:07.648161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.648621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.649440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.649878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.667658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2ce62e69-1757-4aa8-a5ae-cbe69dcea74a tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 204 len: 0 microversion: 2.20 time: 0.381877 Apr 07 17:24:07.668313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 230/471] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Apr 7 17:24:07 2022] DELETE /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 07 17:24:07.682242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:07.686890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:07.689051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.689603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.690368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.690796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.828102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:07.834982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1a44ead5-3de4-41f6-a8ad-71d0abf3e667 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.203281 Apr 07 17:24:07.835568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 242/472] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:07 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:24:07.870396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:07.878068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:07.879555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:07.880697 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8919c33d-af93-4188-adeb-1ba7f2006767 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.202735 Apr 07 17:24:07.881278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 231/473] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:07 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:07.972812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:07.973471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:07.979297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.979736 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:07.980484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:07.980912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:08.109587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:08.116827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-587f8a8a-449c-403a-a733-b22f7e6d7df9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.149012 Apr 07 17:24:08.117430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 243/474] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:07 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:08.852657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:08.853284 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:08.859508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:08.860493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:08.861468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:08.862007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:08.899593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:08.900334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:08.910958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:08.910958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:08.910958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:08.910958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:09.024207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:09.031445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e03f9d94-f281-45f6-936e-a844888b1dc9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1677 microversion: 2.1 time: 0.182589 Apr 07 17:24:09.032053 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 232/475] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:08 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:09.081591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:09.089344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:09.090830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:09.091970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4bb897ea-e6b1-4cd5-a07a-288433ac907d tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.196577 Apr 07 17:24:09.092519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 244/476] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:08 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:24:09.135016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:09.136164 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:09.143517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:09.143972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:09.144741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:09.145201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:09.279995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:09.287767 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3fd980b2-cce1-445e-9891-c2487d94fb13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.158014 Apr 07 17:24:09.288668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 233/477] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:09 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:10.048534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:10.049268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:10.055743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.056187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.056947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.057399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.110388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:10.111067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:10.117951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.118125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.118765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.119188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.228520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:10.237270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0d77371b-229c-453b-ae92-1b125e8cda0c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1654 microversion: 2.1 time: 0.192767 Apr 07 17:24:10.237843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 245/478] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:10 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1654 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:10.254208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ae607232-2440-48d1-8b7d-529c5775e933 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:10.260062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ae607232-2440-48d1-8b7d-529c5775e933 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.260504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ae607232-2440-48d1-8b7d-529c5775e933 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.285348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ae607232-2440-48d1-8b7d-529c5775e933 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Going to try to start instance {{(pid=117703) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 07 17:24:10.292488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:10.302035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:10.303556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:10.304729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-23dd29f9-efc6-4145-a61b-66a8b64509dd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1725 microversion: 2.20 time: 0.198463 Apr 07 17:24:10.313691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 234/479] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:10 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:24:10.313691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:10.313691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:10.318959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.318959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.318959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.319457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.459607 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:10.467181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3618b8c4-5925-4fd3-ab24-ab377de221fa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.160595 Apr 07 17:24:10.467967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 235/480] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:10 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:10.480900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ae607232-2440-48d1-8b7d-529c5775e933 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.231207 Apr 07 17:24:10.481784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 246/481] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:24:10 2022] POST /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 07 17:24:10.490381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:10.493931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:10.496903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.497378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.498141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.498568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.637523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-0abe8b8f-e881-41a2-8154-2495bafee68f req-fcf48790-ac82-45c1-8550-29a592b1d714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bff11525-d802-480e-8301-be7c4bc7746f", "name": "network-vif-deleted", "tag": "bc998428-bafa-45c1-8d70-f3933c8b16ec"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:10.646331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-0abe8b8f-e881-41a2-8154-2495bafee68f req-fcf48790-ac82-45c1-8550-29a592b1d714 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:10.646780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-0abe8b8f-e881-41a2-8154-2495bafee68f req-fcf48790-ac82-45c1-8550-29a592b1d714 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:10.655474 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:10.661591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-0abe8b8f-e881-41a2-8154-2495bafee68f req-fcf48790-ac82-45c1-8550-29a592b1d714 service nova] Creating event network-vif-deleted:bc998428-bafa-45c1-8d70-f3933c8b16ec for instance bff11525-d802-480e-8301-be7c4bc7746f on hv-cinder-83699 Apr 07 17:24:10.665900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0b7f38c7-8045-4c08-8867-d94da3753478 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1663 microversion: 2.1 time: 0.179373 Apr 07 17:24:10.666604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-0abe8b8f-e881-41a2-8154-2495bafee68f req-fcf48790-ac82-45c1-8550-29a592b1d714 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033306 Apr 07 17:24:10.667016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 236/482] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:10 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:10.667196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 247/483] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:24:11.327651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:11.330406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:11.337565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:11.342148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:11.342148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:11.342148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:11.376506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:11.377222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:11.377687 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lazy-loading 'fault' on Instance uuid bff11525-d802-480e-8301-be7c4bc7746f {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:24:11.433394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:11.443395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:11.444904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:11.446107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c8b21803-f294-43e6-94ce-d083ab28a104 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 200 len: 1372 microversion: 2.20 time: 0.124824 Apr 07 17:24:11.446913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 237/484] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:11 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:11.484909 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:11.485770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:11.492159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:11.492606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:11.493424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:11.494040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:11.665572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:11.690258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:11.691236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:11.693899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a3aed712-d581-4009-a4a6-84a2486f6c4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.213594 Apr 07 17:24:11.698636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:11.702035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:11.702176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 248/485] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:11 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:11.702281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:11.702281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:11.931126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:11.947226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-07c75f79-163f-4689-a898-9932e0a25084 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1663 microversion: 2.1 time: 0.267502 Apr 07 17:24:11.948045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 238/486] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:11 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1663 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:12.466060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:12.466673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:12.472644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:12.473090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:12.473880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:12.474330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:12.487677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] HTTP exception thrown: Instance bff11525-d802-480e-8301-be7c4bc7746f could not be found. Apr 07 17:24:12.488282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Returning 404 to user: Instance bff11525-d802-480e-8301-be7c4bc7746f could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:24:12.489068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8a840788-ce1b-441f-8305-825c8178236c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 404 len: 111 microversion: 2.20 time: 0.026936 Apr 07 17:24:12.489624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 249/487] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:12 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:24:12.498022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7ae90884-c31c-4382-adaa-664269fa001c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '.version_select at 0x7ff9d04bd670>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:12.502185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7ae90884-c31c-4382-adaa-664269fa001c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [3ed1f92a-cb7d-4867-95fc-b14e9c23c31f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 17:24:12.715917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:12.716699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:12.723676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:12.724124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:12.724889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:12.725373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:13.091406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:13.099772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d65105c4-54ee-412d-8f43-57e0253fe23a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.387580 Apr 07 17:24:13.100364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 250/488] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:12 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:24:13.105115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:13.105593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:13.115115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:13.115566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:13.116345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:13.116779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:13.263642 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:13.271687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-db2c40e9-08f8-437f-a691-590097756ab5 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1667 microversion: 2.1 time: 0.170352 Apr 07 17:24:13.272254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 251/489] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:13 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1667 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:13.509583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [None req-7ae90884-c31c-4382-adaa-664269fa001c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [3ed1f92a-cb7d-4867-95fc-b14e9c23c31f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 57380. Apr 07 17:24:13.605334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7ae90884-c31c-4382-adaa-664269fa001c tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793611534" status: 204 len: 0 microversion: 2.20 time: 1.111013 Apr 07 17:24:13.605925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 239/490] 10.222.0.26 () {60 vars in 1261 bytes} [Thu Apr 7 17:24:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1793611534 => generated 0 bytes in 1112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 07 17:24:14.117267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:14.117884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:14.124184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:14.124631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:14.126080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:14.126522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:14.262003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:14.270726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6e0fea89-25aa-4634-8130-2bca8f9b4a75 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.157243 Apr 07 17:24:14.271300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 252/491] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:14 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:14.405525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9941974c-46b3-4b74-a12a-7ef89d0673fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Action: 'create', calling method: .version_select at 0x7ff9d0545700>, body: {"keypair": {"name": "tempest-keypair-1606672547"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:14.420200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-9941974c-46b3-4b74-a12a-7ef89d0673fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:24:14.423998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-9941974c-46b3-4b74-a12a-7ef89d0673fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for user 93ce92053f4a4fa1a639726b2685cec2 and project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:24:14.670730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-9941974c-46b3-4b74-a12a-7ef89d0673fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:24:14.675385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-9941974c-46b3-4b74-a12a-7ef89d0673fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for user 93ce92053f4a4fa1a639726b2685cec2 and project cb8370d7baf14d80b8e6f7882864649e. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:24:14.687836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9941974c-46b3-4b74-a12a-7ef89d0673fd tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.286277 Apr 07 17:24:14.688469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 240/492] 10.222.0.26 () {62 vars in 1198 bytes} [Thu Apr 7 17:24:14 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 288 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 07 17:24:15.288591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:15.289230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:15.296007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:15.296588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:15.297266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:15.297754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:15.435524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:15.443339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-613b174e-86c0-469b-bce5-89269c50713c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.158964 Apr 07 17:24:15.443900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 253/493] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:15 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:15.811669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-aa1e9be0-6b12-42c4-a373-cf73b82b3d30 req-83cea3d5-75fa-4f47-adce-332520e08e24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3", "name": "network-vif-plugged", "status": "completed", "tag": "460f0c0e-20d7-48e1-b7d2-e771eec9c91c"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:15.820588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-aa1e9be0-6b12-42c4-a373-cf73b82b3d30 req-83cea3d5-75fa-4f47-adce-332520e08e24 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:15.821039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-aa1e9be0-6b12-42c4-a373-cf73b82b3d30 req-83cea3d5-75fa-4f47-adce-332520e08e24 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:15.831879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-aa1e9be0-6b12-42c4-a373-cf73b82b3d30 req-83cea3d5-75fa-4f47-adce-332520e08e24 service nova] Creating event network-vif-plugged:460f0c0e-20d7-48e1-b7d2-e771eec9c91c for instance fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 on hv-cinder-83699 Apr 07 17:24:15.836824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-aa1e9be0-6b12-42c4-a373-cf73b82b3d30 req-83cea3d5-75fa-4f47-adce-332520e08e24 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029789 Apr 07 17:24:15.837497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 241/494] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:24:16.460854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:16.461496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:16.467868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:16.468313 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:16.469196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:16.470310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:16.605947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:16.613973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fe34a6c1-ec13-4802-955d-3037a49832fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.156928 Apr 07 17:24:16.614543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 254/495] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:16 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:24:16.792308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1163468578", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48457aee-2d0c-465e-805a-fcb617f3be0e"}], "security_groups": [{"name": "tempest-securitygroup--2008993394"}], "key_name": "tempest-keypair-1606672547", "user_data": "}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:16.896569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] validate_networks() for [('48457aee-2d0c-465e-805a-fcb617f3be0e', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:24:17.260995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:24:17.261458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:24:17.261934 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:24:17.262326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:24:17.262731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:24:17.272330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:17.273025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:17.273870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:17.274304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:17.290791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for project cb8370d7baf14d80b8e6f7882864649e. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:24:17.294728 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Getting quotas for user 93ce92053f4a4fa1a639726b2685cec2 and project cb8370d7baf14d80b8e6f7882864649e. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:24:17.305607 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:24:17.307931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:24:17.428485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-322aa378-1e72-4094-ad36-0a6edb84b8ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.640605 Apr 07 17:24:17.429065 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 242/496] 10.222.0.26 () {62 vars in 1187 bytes} [Thu Apr 7 17:24:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 07 17:24:17.439919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5f05628a-0659-4044-b7be-c033ff8cc172 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:17.440613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5f05628a-0659-4044-b7be-c033ff8cc172 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:17.510848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5f05628a-0659-4044-b7be-c033ff8cc172 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:17.519013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5f05628a-0659-4044-b7be-c033ff8cc172 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:17.520524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5f05628a-0659-4044-b7be-c033ff8cc172 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:17.521688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5f05628a-0659-4044-b7be-c033ff8cc172 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1282 microversion: 2.20 time: 0.086471 Apr 07 17:24:17.522245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 255/497] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:17 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:17.631167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:17.631774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:17.639816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:17.640266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:17.641791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:17.642233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:17.776947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:17.788900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2b90e419-46a9-4c65-9e97-1cf6c2f863d9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1319 microversion: 2.1 time: 0.161636 Apr 07 17:24:17.789725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 243/498] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:17 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:24:18.540228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:18.540835 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:18.547912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:18.550697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:18.550697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:18.550697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:18.608484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:18.616414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:18.618203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:18.619354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bf44f6c5-fbf1-4dab-afd3-9513d62ba0d5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1278 microversion: 2.20 time: 0.083040 Apr 07 17:24:18.619914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 256/499] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:18 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:18.806917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:18.807550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:18.814614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:18.815068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:18.815841 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:18.816280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:18.954638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:18.961816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bd2e1692-f611-4daf-9ed9-48521d51311c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1508 microversion: 2.1 time: 0.158752 Apr 07 17:24:18.962717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 244/500] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:18 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:18.979914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-997887ae-97dc-4398-999f-af646611d22c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab73a3bf-f706-413a-8756-9d671d3384b1", "device": "/dev/sdb"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:18.981601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-997887ae-97dc-4398-999f-af646611d22c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:18.987650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-997887ae-97dc-4398-999f-af646611d22c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:18.988102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-997887ae-97dc-4398-999f-af646611d22c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:18.988865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-997887ae-97dc-4398-999f-af646611d22c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:18.989330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-997887ae-97dc-4398-999f-af646611d22c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:19.563619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-997887ae-97dc-4398-999f-af646611d22c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "POST /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.587197 Apr 07 17:24:19.564308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 257/501] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:24:18 2022] POST /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:19.643014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:19.643830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:19.650271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:19.650857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:19.651700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:19.652202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:19.713691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:19.731598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:19.731598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:19.731598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-acd08d10-ba18-4084-a881-03afe3892ec5 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1340 microversion: 2.20 time: 0.087492 Apr 07 17:24:19.731873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 245/502] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:19 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:20.745967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:20.746695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:20.756887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:20.757364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:20.758564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:20.759974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:20.899718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:20.908499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:20.910659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:20.911182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2def7b45-f060-430e-9020-8b36b5b25853 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1408 microversion: 2.20 time: 0.169664 Apr 07 17:24:20.911737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 258/503] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:20 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:20.948275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-ad97b6c3-cc68-457a-b7e9-a9aa4d7a92df req-6561e56d-fc2c-4949-8ae9-4dac698b65cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06", "tag": "0bee210a-53c0-46e7-98f1-ddf5fee1d97c"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:20.957595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-ad97b6c3-cc68-457a-b7e9-a9aa4d7a92df req-6561e56d-fc2c-4949-8ae9-4dac698b65cb service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:20.958044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-ad97b6c3-cc68-457a-b7e9-a9aa4d7a92df req-6561e56d-fc2c-4949-8ae9-4dac698b65cb service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:20.970834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-ad97b6c3-cc68-457a-b7e9-a9aa4d7a92df req-6561e56d-fc2c-4949-8ae9-4dac698b65cb service nova] Creating event network-changed:0bee210a-53c0-46e7-98f1-ddf5fee1d97c for instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 on hv-cinder-83699 Apr 07 17:24:20.975885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-ad97b6c3-cc68-457a-b7e9-a9aa4d7a92df req-6561e56d-fc2c-4949-8ae9-4dac698b65cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031242 Apr 07 17:24:20.976499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 246/504] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:21.929488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:21.930101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:21.936451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:21.936906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:21.937749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:21.938190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:22.070935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:22.078707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:22.080209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:22.081353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-659b3f5a-513e-4347-b605-ada7ef75eca3 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1408 microversion: 2.20 time: 0.155932 Apr 07 17:24:22.081917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 259/505] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:21 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:23.100624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:23.101333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:23.107452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:23.107892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:23.108637 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:23.109068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:23.240547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:23.248210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:23.249735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:23.251451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6dda2c48-0c61-4022-81c7-9f2c577d6019 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1408 microversion: 2.20 time: 0.155492 Apr 07 17:24:23.252009 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 247/506] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:23 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:24.269565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:24.270188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:24.277012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:24.277486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:24.278252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:24.278683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:24.409743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:24.418085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:24.419591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:24.420681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9851e6fd-b615-41d5-922e-2bc578203666 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1408 microversion: 2.20 time: 0.155698 Apr 07 17:24:24.421284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 260/507] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:24 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:25.439742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:25.440345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:25.446770 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:25.447220 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:25.447980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:25.448422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:25.583111 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:25.590838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:25.592345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:25.593483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7d294708-17ea-4768-a85a-aa21ac3be4c7 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1408 microversion: 2.20 time: 0.158196 Apr 07 17:24:25.594158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 248/508] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:25 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:25.901328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-a8ee04d7-9d1e-4580-9cbb-48df4055e49f req-1b97d8a0-bce3-4714-a548-51330e90715f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06", "name": "network-vif-plugged", "status": "completed", "tag": "0bee210a-53c0-46e7-98f1-ddf5fee1d97c"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:25.916950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-a8ee04d7-9d1e-4580-9cbb-48df4055e49f req-1b97d8a0-bce3-4714-a548-51330e90715f service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:25.916950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-a8ee04d7-9d1e-4580-9cbb-48df4055e49f req-1b97d8a0-bce3-4714-a548-51330e90715f service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:25.924066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-a8ee04d7-9d1e-4580-9cbb-48df4055e49f req-1b97d8a0-bce3-4714-a548-51330e90715f service nova] Creating event network-vif-plugged:0bee210a-53c0-46e7-98f1-ddf5fee1d97c for instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 on hv-cinder-83699 Apr 07 17:24:25.928998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-a8ee04d7-9d1e-4580-9cbb-48df4055e49f req-1b97d8a0-bce3-4714-a548-51330e90715f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Apr 07 17:24:25.929551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 261/509] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:26.612550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:26.613176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:26.619493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:26.630448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:26.630448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:26.630448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:26.751319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:26.759184 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:26.760682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:26.761817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bb4647ff-9881-4bc6-b535-a4594feee92f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1408 microversion: 2.20 time: 0.154228 Apr 07 17:24:26.762413 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 249/510] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:26 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:27.782538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:27.783235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:27.789415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:27.789871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:27.790637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:27.791077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:27.927505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:27.935422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:27.936983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:27.938283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ffb6a359-d62a-4e3e-804c-018579d0d227 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1408 microversion: 2.20 time: 0.160577 Apr 07 17:24:27.946828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 262/511] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:27 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:24:28.956515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:28.957107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:28.963371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:28.966308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:28.966308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:28.966308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:29.098472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:29.106403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:29.107947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:29.109112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-666347c2-07d0-46fc-947c-6a1aa15b8b33 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1600 microversion: 2.20 time: 0.157108 Apr 07 17:24:29.110195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 250/512] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:24:28 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:24:29.127700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c5acdf93-c7ca-4ee0-8162-3fa36f2aefb1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:29.128197 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c5acdf93-c7ca-4ee0-8162-3fa36f2aefb1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:29.134438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5acdf93-c7ca-4ee0-8162-3fa36f2aefb1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:29.134897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5acdf93-c7ca-4ee0-8162-3fa36f2aefb1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:29.135662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5acdf93-c7ca-4ee0-8162-3fa36f2aefb1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:29.136106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5acdf93-c7ca-4ee0-8162-3fa36f2aefb1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:29.216583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c5acdf93-c7ca-4ee0-8162-3fa36f2aefb1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093333 Apr 07 17:24:29.217309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 263/513] 10.222.0.26 () {60 vars in 1315 bytes} [Thu Apr 7 17:24:29 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:24:30.432709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-6ed488cb-c1d8-4af5-9ba8-b43a7ec13e2a req-a83ee9d9-2819-4a20-9f3b-84f8a4c3aad1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06", "tag": "0bee210a-53c0-46e7-98f1-ddf5fee1d97c"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:30.441911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-6ed488cb-c1d8-4af5-9ba8-b43a7ec13e2a req-a83ee9d9-2819-4a20-9f3b-84f8a4c3aad1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:30.442357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-6ed488cb-c1d8-4af5-9ba8-b43a7ec13e2a req-a83ee9d9-2819-4a20-9f3b-84f8a4c3aad1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:30.454165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-6ed488cb-c1d8-4af5-9ba8-b43a7ec13e2a req-a83ee9d9-2819-4a20-9f3b-84f8a4c3aad1 service nova] Creating event network-changed:0bee210a-53c0-46e7-98f1-ddf5fee1d97c for instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 on hv-cinder-83699 Apr 07 17:24:30.459187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-6ed488cb-c1d8-4af5-9ba8-b43a7ec13e2a req-a83ee9d9-2819-4a20-9f3b-84f8a4c3aad1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030128 Apr 07 17:24:30.459962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 251/514] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:32.142495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:32.143022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:32.149050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:32.149525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:32.150283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:32.150714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:32.230057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lazy-loading 'services' on Instance uuid 3966d8bc-6664-4582-a275-e7dcfbcba3cc {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:24:32.455740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6c8d011a-5c7b-4c47-aeba-87e201058915 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments/a29a31d3-0cf8-431a-9050-91e796fa495d" status: 202 len: 0 microversion: 2.1 time: 0.318233 Apr 07 17:24:32.456672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 264/515] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:24:32 2022] DELETE /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments/a29a31d3-0cf8-431a-9050-91e796fa495d => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:24:32.466138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-655e39de-d524-483d-8c52-66f3bdfc6c0d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:32.467335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-655e39de-d524-483d-8c52-66f3bdfc6c0d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:32.478918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-655e39de-d524-483d-8c52-66f3bdfc6c0d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:32.479374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-655e39de-d524-483d-8c52-66f3bdfc6c0d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:32.480156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-655e39de-d524-483d-8c52-66f3bdfc6c0d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:32.480592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-655e39de-d524-483d-8c52-66f3bdfc6c0d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:32.519030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-655e39de-d524-483d-8c52-66f3bdfc6c0d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057849 Apr 07 17:24:32.519869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 252/516] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:33.531719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c56fc1e6-9f6b-4635-a5aa-a87edc6f4216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:33.532707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c56fc1e6-9f6b-4635-a5aa-a87edc6f4216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:33.539213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c56fc1e6-9f6b-4635-a5aa-a87edc6f4216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:33.539655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c56fc1e6-9f6b-4635-a5aa-a87edc6f4216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:33.540412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c56fc1e6-9f6b-4635-a5aa-a87edc6f4216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:33.540840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c56fc1e6-9f6b-4635-a5aa-a87edc6f4216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:33.572915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c56fc1e6-9f6b-4635-a5aa-a87edc6f4216 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Apr 07 17:24:33.574127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 265/517] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:34.584999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0d8ca41a-46dc-4d63-a947-93733a2005c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:34.585963 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0d8ca41a-46dc-4d63-a947-93733a2005c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:34.591960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d8ca41a-46dc-4d63-a947-93733a2005c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:34.592407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d8ca41a-46dc-4d63-a947-93733a2005c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:34.593181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d8ca41a-46dc-4d63-a947-93733a2005c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:34.593620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d8ca41a-46dc-4d63-a947-93733a2005c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:34.621394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0d8ca41a-46dc-4d63-a947-93733a2005c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040262 Apr 07 17:24:34.621938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 253/518] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:35.632826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9175e96f-a348-4bd4-8c56-04424e83d42e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:35.633796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9175e96f-a348-4bd4-8c56-04424e83d42e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:35.640085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9175e96f-a348-4bd4-8c56-04424e83d42e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:35.640536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9175e96f-a348-4bd4-8c56-04424e83d42e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:35.641508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9175e96f-a348-4bd4-8c56-04424e83d42e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:35.641785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9175e96f-a348-4bd4-8c56-04424e83d42e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:35.670914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9175e96f-a348-4bd4-8c56-04424e83d42e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Apr 07 17:24:35.671470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 266/519] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:36.684052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e47c8bf3-6ff8-469f-a0b9-86df4e6eaa2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:36.684966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e47c8bf3-6ff8-469f-a0b9-86df4e6eaa2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:36.691287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47c8bf3-6ff8-469f-a0b9-86df4e6eaa2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:36.691735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47c8bf3-6ff8-469f-a0b9-86df4e6eaa2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:36.692495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47c8bf3-6ff8-469f-a0b9-86df4e6eaa2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:36.692933 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47c8bf3-6ff8-469f-a0b9-86df4e6eaa2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:36.721461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e47c8bf3-6ff8-469f-a0b9-86df4e6eaa2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041436 Apr 07 17:24:36.722003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 254/520] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:37.732658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5d5df84f-6a0b-4239-8104-a34d1429abba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:37.736173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5d5df84f-6a0b-4239-8104-a34d1429abba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:37.740685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d5df84f-6a0b-4239-8104-a34d1429abba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:37.741127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d5df84f-6a0b-4239-8104-a34d1429abba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:37.741932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d5df84f-6a0b-4239-8104-a34d1429abba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:37.742364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d5df84f-6a0b-4239-8104-a34d1429abba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:37.770682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5d5df84f-6a0b-4239-8104-a34d1429abba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041961 Apr 07 17:24:37.771223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 267/521] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:38.783136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-63a9f1e4-166a-4ef8-a78c-19742d47c0bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:38.784058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-63a9f1e4-166a-4ef8-a78c-19742d47c0bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:38.790369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-63a9f1e4-166a-4ef8-a78c-19742d47c0bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:38.790821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-63a9f1e4-166a-4ef8-a78c-19742d47c0bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:38.791583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-63a9f1e4-166a-4ef8-a78c-19742d47c0bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:38.792019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-63a9f1e4-166a-4ef8-a78c-19742d47c0bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:38.819161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-63a9f1e4-166a-4ef8-a78c-19742d47c0bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040709 Apr 07 17:24:38.819700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 255/522] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:39.831555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2d0338bc-5244-43be-bb38-ab74e61fb7cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:39.832467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2d0338bc-5244-43be-bb38-ab74e61fb7cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:39.838738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d0338bc-5244-43be-bb38-ab74e61fb7cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:39.839184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d0338bc-5244-43be-bb38-ab74e61fb7cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:39.839938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d0338bc-5244-43be-bb38-ab74e61fb7cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:39.840371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d0338bc-5244-43be-bb38-ab74e61fb7cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:39.869211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2d0338bc-5244-43be-bb38-ab74e61fb7cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042449 Apr 07 17:24:39.869764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 268/523] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:40.880579 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-95f5ab4e-81a6-4e8e-9049-e045d6693e5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:40.881553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-95f5ab4e-81a6-4e8e-9049-e045d6693e5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:40.888021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95f5ab4e-81a6-4e8e-9049-e045d6693e5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:40.888466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95f5ab4e-81a6-4e8e-9049-e045d6693e5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:40.889262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95f5ab4e-81a6-4e8e-9049-e045d6693e5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:40.889755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95f5ab4e-81a6-4e8e-9049-e045d6693e5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:40.918650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-95f5ab4e-81a6-4e8e-9049-e045d6693e5c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042641 Apr 07 17:24:40.919203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 256/524] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:41.930422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d1940960-de2f-4e6b-a3c3-f5f4e8d55cfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:41.931335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d1940960-de2f-4e6b-a3c3-f5f4e8d55cfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:41.937626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1940960-de2f-4e6b-a3c3-f5f4e8d55cfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:41.938072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1940960-de2f-4e6b-a3c3-f5f4e8d55cfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:41.938866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1940960-de2f-4e6b-a3c3-f5f4e8d55cfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:41.939684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d1940960-de2f-4e6b-a3c3-f5f4e8d55cfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:41.968200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d1940960-de2f-4e6b-a3c3-f5f4e8d55cfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041827 Apr 07 17:24:41.968761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 269/525] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:24:42.980494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a86c93f9-cbe1-4fb0-8073-a6ccf29778fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:42.981442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a86c93f9-cbe1-4fb0-8073-a6ccf29778fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:42.988538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a86c93f9-cbe1-4fb0-8073-a6ccf29778fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:42.988981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a86c93f9-cbe1-4fb0-8073-a6ccf29778fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:42.989773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a86c93f9-cbe1-4fb0-8073-a6ccf29778fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:42.990206 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a86c93f9-cbe1-4fb0-8073-a6ccf29778fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:43.017782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a86c93f9-cbe1-4fb0-8073-a6ccf29778fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041014 Apr 07 17:24:43.018337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 257/526] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:44.029626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-63ba13f6-2288-4571-86f2-5b53f48b4af3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:44.030542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-63ba13f6-2288-4571-86f2-5b53f48b4af3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:44.036921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63ba13f6-2288-4571-86f2-5b53f48b4af3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:44.037406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63ba13f6-2288-4571-86f2-5b53f48b4af3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:44.038175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63ba13f6-2288-4571-86f2-5b53f48b4af3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:44.038605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63ba13f6-2288-4571-86f2-5b53f48b4af3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:44.067911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-63ba13f6-2288-4571-86f2-5b53f48b4af3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042180 Apr 07 17:24:44.068465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 270/527] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:45.079433 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5d1cb31f-56ff-4a2b-9b43-7b655bd4c085 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:45.081008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5d1cb31f-56ff-4a2b-9b43-7b655bd4c085 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:45.087265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1cb31f-56ff-4a2b-9b43-7b655bd4c085 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:45.087711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1cb31f-56ff-4a2b-9b43-7b655bd4c085 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:45.088469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1cb31f-56ff-4a2b-9b43-7b655bd4c085 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:45.088901 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1cb31f-56ff-4a2b-9b43-7b655bd4c085 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:45.116838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5d1cb31f-56ff-4a2b-9b43-7b655bd4c085 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041261 Apr 07 17:24:45.117349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 258/528] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:46.128269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4e6e2dc0-43b3-47fb-8322-0b4c0cfdaafb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:46.129242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4e6e2dc0-43b3-47fb-8322-0b4c0cfdaafb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:46.135568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e6e2dc0-43b3-47fb-8322-0b4c0cfdaafb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:46.136023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e6e2dc0-43b3-47fb-8322-0b4c0cfdaafb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:46.136788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e6e2dc0-43b3-47fb-8322-0b4c0cfdaafb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:46.137255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e6e2dc0-43b3-47fb-8322-0b4c0cfdaafb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:46.166488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4e6e2dc0-43b3-47fb-8322-0b4c0cfdaafb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Apr 07 17:24:46.167042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 271/529] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:47.178172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d9ee4582-c51b-4d70-b27b-5d4c9b5353cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:47.179089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d9ee4582-c51b-4d70-b27b-5d4c9b5353cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:47.185292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9ee4582-c51b-4d70-b27b-5d4c9b5353cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:47.185735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9ee4582-c51b-4d70-b27b-5d4c9b5353cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:47.186475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9ee4582-c51b-4d70-b27b-5d4c9b5353cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:47.186930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9ee4582-c51b-4d70-b27b-5d4c9b5353cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:47.215659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d9ee4582-c51b-4d70-b27b-5d4c9b5353cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 Apr 07 17:24:47.216215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 259/530] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:48.227202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7332d109-106e-4176-bd8b-eb99ebe7e8ce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:48.228126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7332d109-106e-4176-bd8b-eb99ebe7e8ce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:48.234733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7332d109-106e-4176-bd8b-eb99ebe7e8ce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:48.235186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7332d109-106e-4176-bd8b-eb99ebe7e8ce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:48.236590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7332d109-106e-4176-bd8b-eb99ebe7e8ce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:48.237029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7332d109-106e-4176-bd8b-eb99ebe7e8ce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:48.264552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7332d109-106e-4176-bd8b-eb99ebe7e8ce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041341 Apr 07 17:24:48.265096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 272/531] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:49.276509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a46ee064-7783-43ef-9c88-36d4eec2895e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:49.277456 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a46ee064-7783-43ef-9c88-36d4eec2895e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:49.284386 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a46ee064-7783-43ef-9c88-36d4eec2895e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:49.284833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a46ee064-7783-43ef-9c88-36d4eec2895e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:49.285617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a46ee064-7783-43ef-9c88-36d4eec2895e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:49.286056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a46ee064-7783-43ef-9c88-36d4eec2895e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:49.313805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a46ee064-7783-43ef-9c88-36d4eec2895e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041506 Apr 07 17:24:49.314520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 260/532] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:50.325440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b1cbaf1e-2d5c-401d-ba23-1d059fb4fd13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:50.326392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b1cbaf1e-2d5c-401d-ba23-1d059fb4fd13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:50.332861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1cbaf1e-2d5c-401d-ba23-1d059fb4fd13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:50.333400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1cbaf1e-2d5c-401d-ba23-1d059fb4fd13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:50.334132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1cbaf1e-2d5c-401d-ba23-1d059fb4fd13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:50.334570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1cbaf1e-2d5c-401d-ba23-1d059fb4fd13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:50.365761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b1cbaf1e-2d5c-401d-ba23-1d059fb4fd13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Apr 07 17:24:50.366326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 273/533] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:51.378970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dbb94ff7-f355-4800-90cc-d228cac49e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:51.380048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dbb94ff7-f355-4800-90cc-d228cac49e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:51.388262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dbb94ff7-f355-4800-90cc-d228cac49e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:51.388981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dbb94ff7-f355-4800-90cc-d228cac49e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:51.390092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dbb94ff7-f355-4800-90cc-d228cac49e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:51.390699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dbb94ff7-f355-4800-90cc-d228cac49e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:51.421885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dbb94ff7-f355-4800-90cc-d228cac49e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048291 Apr 07 17:24:51.422429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 261/534] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:52.433425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-032a1c5a-4c6c-4082-9ce1-6c7473e90583 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:52.434339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-032a1c5a-4c6c-4082-9ce1-6c7473e90583 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:52.440816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-032a1c5a-4c6c-4082-9ce1-6c7473e90583 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:52.441293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-032a1c5a-4c6c-4082-9ce1-6c7473e90583 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:52.442059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-032a1c5a-4c6c-4082-9ce1-6c7473e90583 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:52.442490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-032a1c5a-4c6c-4082-9ce1-6c7473e90583 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:52.471272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-032a1c5a-4c6c-4082-9ce1-6c7473e90583 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 Apr 07 17:24:52.471807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 274/535] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:53.482467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6550d07a-85f0-41be-8667-34b4b8a5ba36 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:53.490915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6550d07a-85f0-41be-8667-34b4b8a5ba36 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:53.490915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6550d07a-85f0-41be-8667-34b4b8a5ba36 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:53.491159 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6550d07a-85f0-41be-8667-34b4b8a5ba36 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:53.491902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6550d07a-85f0-41be-8667-34b4b8a5ba36 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:53.492332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6550d07a-85f0-41be-8667-34b4b8a5ba36 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:53.520999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6550d07a-85f0-41be-8667-34b4b8a5ba36 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042506 Apr 07 17:24:53.523864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 262/536] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:54.448767 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7adc203e-bc7f-46b4-a67a-5e73969daee3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:54.449710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7adc203e-bc7f-46b4-a67a-5e73969daee3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:54.456870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7adc203e-bc7f-46b4-a67a-5e73969daee3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.457347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7adc203e-bc7f-46b4-a67a-5e73969daee3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.458105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7adc203e-bc7f-46b4-a67a-5e73969daee3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.458638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7adc203e-bc7f-46b4-a67a-5e73969daee3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.486121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7adc203e-bc7f-46b4-a67a-5e73969daee3 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040610 Apr 07 17:24:54.486666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 275/537] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:54 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 17:24:54.532142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-083dc883-f3ba-47ab-bd3d-e3a74a1b75fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:54.533755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-083dc883-f3ba-47ab-bd3d-e3a74a1b75fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:54.540338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-083dc883-f3ba-47ab-bd3d-e3a74a1b75fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.540778 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-083dc883-f3ba-47ab-bd3d-e3a74a1b75fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.541568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-083dc883-f3ba-47ab-bd3d-e3a74a1b75fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.541998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-083dc883-f3ba-47ab-bd3d-e3a74a1b75fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.543252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:54.543750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:54.550321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.550767 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.551535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.551970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.572276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-083dc883-f3ba-47ab-bd3d-e3a74a1b75fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Apr 07 17:24:54.572872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 263/538] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:54.576201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:24:54.757758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b208d71b-d30c-4893-8147-9c10dbca60ca tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 204 len: 0 microversion: 2.1 time: 0.218086 Apr 07 17:24:54.758342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 276/539] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:24:54 2022] DELETE /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 07 17:24:54.766262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:54.766918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:54.772716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.773470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.774234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:54.774666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:54.955296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:54.962727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7dd3b5fb-35da-48d9-a346-f1d3d2d09ec4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1673 microversion: 2.1 time: 0.200227 Apr 07 17:24:54.963308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 264/540] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:54 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1673 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:55.585111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c4983fa0-a789-48f8-b08f-18b829cdad57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:55.586105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c4983fa0-a789-48f8-b08f-18b829cdad57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:55.592491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4983fa0-a789-48f8-b08f-18b829cdad57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:55.592946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4983fa0-a789-48f8-b08f-18b829cdad57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:55.593741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4983fa0-a789-48f8-b08f-18b829cdad57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:55.594178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4983fa0-a789-48f8-b08f-18b829cdad57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:55.622756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c4983fa0-a789-48f8-b08f-18b829cdad57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042113 Apr 07 17:24:55.623306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 277/541] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:55.981332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:55.981936 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:55.990293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:55.990745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:55.991514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:55.991942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:56.146820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:56.156557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9abe1799-0ebb-4259-8201-523f27a00bad tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1673 microversion: 2.1 time: 0.179591 Apr 07 17:24:56.157125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 265/542] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:55 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:56.687096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-79176643-370d-411a-bf47-6e3437ec697b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:56.688002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-79176643-370d-411a-bf47-6e3437ec697b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:56.694076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79176643-370d-411a-bf47-6e3437ec697b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:56.694517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79176643-370d-411a-bf47-6e3437ec697b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:56.695272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79176643-370d-411a-bf47-6e3437ec697b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:56.695704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-79176643-370d-411a-bf47-6e3437ec697b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:56.725149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-79176643-370d-411a-bf47-6e3437ec697b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094258 Apr 07 17:24:56.725725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 278/543] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:57.178309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:57.178928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:57.185757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:57.186205 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:57.186980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:57.187416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:57.324807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:57.332735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b505bdad-57a5-4159-ad18-a8846406586f tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1673 microversion: 2.1 time: 0.158378 Apr 07 17:24:57.333320 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 266/544] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:57 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:57.737422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f8abd358-3114-4f58-a83f-e774b9342af2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:57.738415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f8abd358-3114-4f58-a83f-e774b9342af2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:57.744718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8abd358-3114-4f58-a83f-e774b9342af2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:57.745186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8abd358-3114-4f58-a83f-e774b9342af2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:57.745959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8abd358-3114-4f58-a83f-e774b9342af2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:57.746393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8abd358-3114-4f58-a83f-e774b9342af2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:57.775174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f8abd358-3114-4f58-a83f-e774b9342af2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041938 Apr 07 17:24:57.775736 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 279/545] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:24:57.960115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-1cda8dc7-7c7f-4a22-8a88-f05b93d9d40b req-be005e77-01ca-4d19-852f-29f38577c343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48aed11-0395-43fe-8a15-18ec4fc83ae2", "name": "network-vif-deleted", "tag": "74eba21d-dbe0-4928-ab98-03294512797f"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:24:57.968024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-1cda8dc7-7c7f-4a22-8a88-f05b93d9d40b req-be005e77-01ca-4d19-852f-29f38577c343 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:57.968475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-1cda8dc7-7c7f-4a22-8a88-f05b93d9d40b req-be005e77-01ca-4d19-852f-29f38577c343 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:57.979623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-1cda8dc7-7c7f-4a22-8a88-f05b93d9d40b req-be005e77-01ca-4d19-852f-29f38577c343 service nova] Creating event network-vif-deleted:74eba21d-dbe0-4928-ab98-03294512797f for instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 on hv-cinder-83699 Apr 07 17:24:57.984822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-1cda8dc7-7c7f-4a22-8a88-f05b93d9d40b req-be005e77-01ca-4d19-852f-29f38577c343 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028348 Apr 07 17:24:57.985523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 267/546] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:24:58.349731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:58.350450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:58.356241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:58.356821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:58.357626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:58.358071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:58.389106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:58.389587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:58.390068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lazy-loading 'fault' on Instance uuid c48aed11-0395-43fe-8a15-18ec4fc83ae2 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:24:58.479726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:24:58.488588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5d2821cc-6bcd-40a6-922b-1ad9c1155208 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 200 len: 1327 microversion: 2.1 time: 0.142734 Apr 07 17:24:58.489169 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 280/547] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:58 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:24:58.558934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:24:58.559172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:24:58.788155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9feee87c-8245-497d-a6ec-cf05ab5ea535 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:58.789175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9feee87c-8245-497d-a6ec-cf05ab5ea535 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:58.795722 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9feee87c-8245-497d-a6ec-cf05ab5ea535 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:58.796172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9feee87c-8245-497d-a6ec-cf05ab5ea535 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:58.796944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9feee87c-8245-497d-a6ec-cf05ab5ea535 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:58.797411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9feee87c-8245-497d-a6ec-cf05ab5ea535 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:58.835145 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9feee87c-8245-497d-a6ec-cf05ab5ea535 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052442 Apr 07 17:24:58.839000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 268/548] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:24:59.508192 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:59.508802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:59.515165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:59.515641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:59.516410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:59.517559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:59.530710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] HTTP exception thrown: Instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 could not be found. Apr 07 17:24:59.531291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Returning 404 to user: Instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:24:59.532108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-07c0dff5-0569-4fd8-8e0d-12b0bd11ce38 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 404 len: 111 microversion: 2.1 time: 0.028361 Apr 07 17:24:59.532727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 281/549] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:24:59 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:24:59.540922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-65563fde-8802-4fc1-aa20-2722ba70fcb7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '.version_select at 0x7ff9d0433d30>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:59.662101 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-65563fde-8802-4fc1-aa20-2722ba70fcb7 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-139772271" status: 202 len: 0 microversion: 2.1 time: 0.124838 Apr 07 17:24:59.662679 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 269/550] 10.222.0.26 () {58 vars in 1217 bytes} [Thu Apr 7 17:24:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-139772271 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:24:59.851152 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-97fd0f96-00f5-422e-8c6e-16234c6148bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:24:59.851676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-97fd0f96-00f5-422e-8c6e-16234c6148bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:24:59.859570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97fd0f96-00f5-422e-8c6e-16234c6148bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:59.861542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97fd0f96-00f5-422e-8c6e-16234c6148bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:59.863603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97fd0f96-00f5-422e-8c6e-16234c6148bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:24:59.864606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97fd0f96-00f5-422e-8c6e-16234c6148bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:24:59.907351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-97fd0f96-00f5-422e-8c6e-16234c6148bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063268 Apr 07 17:24:59.908498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 282/551] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:24:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:00.407091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f972078a-7d4f-4df9-8269-806f3e811555 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'create', calling method: .version_select at 0x7ff9d03ed550>, body: {"keypair": {"name": "tempest-keypair-24160259"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:25:00.423773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-f972078a-7d4f-4df9-8269-806f3e811555 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:25:00.427712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-f972078a-7d4f-4df9-8269-806f3e811555 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for user 94e99c7ac26f44f3953fe1296cd5248b and project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:25:00.642001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-f972078a-7d4f-4df9-8269-806f3e811555 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:25:00.645596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-f972078a-7d4f-4df9-8269-806f3e811555 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for user 94e99c7ac26f44f3953fe1296cd5248b and project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:25:00.658745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f972078a-7d4f-4df9-8269-806f3e811555 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.255632 Apr 07 17:25:00.659335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 270/552] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:25:00 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:00.919563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-eb0bc13d-dac3-4b59-8752-43a03ee1ab28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:00.920486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-eb0bc13d-dac3-4b59-8752-43a03ee1ab28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:00.927854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb0bc13d-dac3-4b59-8752-43a03ee1ab28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:00.928304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb0bc13d-dac3-4b59-8752-43a03ee1ab28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:00.929068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb0bc13d-dac3-4b59-8752-43a03ee1ab28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:00.929534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb0bc13d-dac3-4b59-8752-43a03ee1ab28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:00.958692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-eb0bc13d-dac3-4b59-8752-43a03ee1ab28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043096 Apr 07 17:25:00.959451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 283/553] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:01.970602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d5b8d765-151a-4d2d-97c6-29bfa69c46a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:01.971780 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d5b8d765-151a-4d2d-97c6-29bfa69c46a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:01.977678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5b8d765-151a-4d2d-97c6-29bfa69c46a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:01.978071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5b8d765-151a-4d2d-97c6-29bfa69c46a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:01.978833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5b8d765-151a-4d2d-97c6-29bfa69c46a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:01.979265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5b8d765-151a-4d2d-97c6-29bfa69c46a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:02.016517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d5b8d765-151a-4d2d-97c6-29bfa69c46a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050336 Apr 07 17:25:02.017091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 271/554] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:02.731657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1222898342", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d1853f71-2509-481a-81b6-2c17c428061c"}], "security_groups": [{"name": "tempest-securitygroup--534159814"}], "key_name": "tempest-keypair-24160259", "user_data": "}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:25:02.829315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] validate_networks() for [('d1853f71-2509-481a-81b6-2c17c428061c', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:25:03.028294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a1bc77b7-00a5-4342-8727-5f7a81e709f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:03.029318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a1bc77b7-00a5-4342-8727-5f7a81e709f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:03.036776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1bc77b7-00a5-4342-8727-5f7a81e709f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:03.037293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1bc77b7-00a5-4342-8727-5f7a81e709f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:03.038066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1bc77b7-00a5-4342-8727-5f7a81e709f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:03.038503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1bc77b7-00a5-4342-8727-5f7a81e709f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:03.067505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a1bc77b7-00a5-4342-8727-5f7a81e709f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043266 Apr 07 17:25:03.068064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 272/555] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:25:03.206508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:25:03.206508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:25:03.206957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:25:03.207366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:25:03.207775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:25:03.216563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:03.217011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:03.217885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:03.218316 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:03.237103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:25:03.240936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Getting quotas for user 94e99c7ac26f44f3953fe1296cd5248b and project e448dae4841d45baa3fdfbbe6fd0a89c. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:25:03.251792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:25:03.254627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:25:03.372721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-71637be3-edd5-45fe-b03f-851befbd6098 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.645184 Apr 07 17:25:03.373610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 284/556] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:25:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:25:03.383649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4821108e-c6cb-412d-afe9-446e4cb62ea1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:03.384285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4821108e-c6cb-412d-afe9-446e4cb62ea1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:03.445524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4821108e-c6cb-412d-afe9-446e4cb62ea1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:03.452031 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4821108e-c6cb-412d-afe9-446e4cb62ea1 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1236 microversion: 2.1 time: 0.072261 Apr 07 17:25:03.452630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 273/557] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:03 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:04.079144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7ca6eb7b-4257-4e39-97aa-481778fd0d4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:04.080789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7ca6eb7b-4257-4e39-97aa-481778fd0d4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:04.089301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ca6eb7b-4257-4e39-97aa-481778fd0d4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:04.091502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ca6eb7b-4257-4e39-97aa-481778fd0d4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:04.091502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ca6eb7b-4257-4e39-97aa-481778fd0d4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:04.091502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ca6eb7b-4257-4e39-97aa-481778fd0d4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:04.118907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7ca6eb7b-4257-4e39-97aa-481778fd0d4b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Apr 07 17:25:04.119583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 285/558] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:04.469843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:04.470371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:04.476721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:04.477187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:04.477943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:04.478370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:04.539705 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:04.547157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2f48f2bd-1ba8-4caa-a010-2397d856fac4 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1240 microversion: 2.1 time: 0.081260 Apr 07 17:25:04.548541 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 274/559] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:04 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:04.966396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f7c0a254-41d9-4dd8-87ab-cc19a476a169 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:04.966969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f7c0a254-41d9-4dd8-87ab-cc19a476a169 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:04.973703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c0a254-41d9-4dd8-87ab-cc19a476a169 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:04.974163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c0a254-41d9-4dd8-87ab-cc19a476a169 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:04.974927 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c0a254-41d9-4dd8-87ab-cc19a476a169 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:04.975540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7c0a254-41d9-4dd8-87ab-cc19a476a169 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:04.997658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f7c0a254-41d9-4dd8-87ab-cc19a476a169 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06/ips" status: 200 len: 152 microversion: 2.20 time: 0.089077 Apr 07 17:25:04.998217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 286/560] 10.222.0.26 () {60 vars in 1288 bytes} [Thu Apr 7 17:25:04 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06/ips => generated 152 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:25:05.131156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cfd20eda-38eb-4130-9363-1d678dc73e2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:05.132162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cfd20eda-38eb-4130-9363-1d678dc73e2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:05.138207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfd20eda-38eb-4130-9363-1d678dc73e2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:05.138706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfd20eda-38eb-4130-9363-1d678dc73e2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:05.139509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfd20eda-38eb-4130-9363-1d678dc73e2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:05.139958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfd20eda-38eb-4130-9363-1d678dc73e2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:05.170310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cfd20eda-38eb-4130-9363-1d678dc73e2a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Apr 07 17:25:05.175012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 275/561] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:05.563854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:05.564544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:05.571030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:05.571705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:05.572547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:05.573023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:05.638196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:05.645737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f77075b8-c110-453c-a798-0fc64359e738 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1294 microversion: 2.1 time: 0.085799 Apr 07 17:25:05.655979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 287/562] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:05 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:06.182104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f526550f-fbb5-4104-924b-11266347e176 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:06.183029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f526550f-fbb5-4104-924b-11266347e176 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:06.191030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f526550f-fbb5-4104-924b-11266347e176 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:06.191495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f526550f-fbb5-4104-924b-11266347e176 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:06.192262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f526550f-fbb5-4104-924b-11266347e176 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:06.192699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f526550f-fbb5-4104-924b-11266347e176 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:06.221945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f526550f-fbb5-4104-924b-11266347e176 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Apr 07 17:25:06.222443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 276/563] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:06.663350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:06.664121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:06.671392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:06.671976 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:06.672854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:06.673553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:06.814778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:06.823841 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f0308a22-62ab-49b6-944f-ecd709e580e8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1361 microversion: 2.1 time: 0.164966 Apr 07 17:25:06.824550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 288/564] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:06 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:06.905784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-31b49ff2-cf53-459e-a84a-9f5f1d0eb831 req-117f894f-2501-4684-a338-00a7df23b60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ffd683-613d-4c1a-9df2-0250be28226e", "tag": "cb147af4-39f2-4945-9290-bc42a9da9fb4"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:25:06.915069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-31b49ff2-cf53-459e-a84a-9f5f1d0eb831 req-117f894f-2501-4684-a338-00a7df23b60a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:06.915759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-31b49ff2-cf53-459e-a84a-9f5f1d0eb831 req-117f894f-2501-4684-a338-00a7df23b60a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:06.927837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-31b49ff2-cf53-459e-a84a-9f5f1d0eb831 req-117f894f-2501-4684-a338-00a7df23b60a service nova] Creating event network-changed:cb147af4-39f2-4945-9290-bc42a9da9fb4 for instance 19ffd683-613d-4c1a-9df2-0250be28226e on hv-cinder-83699 Apr 07 17:25:06.933448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-31b49ff2-cf53-459e-a84a-9f5f1d0eb831 req-117f894f-2501-4684-a338-00a7df23b60a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100021 Apr 07 17:25:06.934144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 277/565] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:07.233766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ec5c54f9-d4fe-4b5e-9e72-40ce9e7a4d7b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:07.234745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ec5c54f9-d4fe-4b5e-9e72-40ce9e7a4d7b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:07.240702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec5c54f9-d4fe-4b5e-9e72-40ce9e7a4d7b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:07.241179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec5c54f9-d4fe-4b5e-9e72-40ce9e7a4d7b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:07.242127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec5c54f9-d4fe-4b5e-9e72-40ce9e7a4d7b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:07.242566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec5c54f9-d4fe-4b5e-9e72-40ce9e7a4d7b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:07.270623 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ec5c54f9-d4fe-4b5e-9e72-40ce9e7a4d7b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041011 Apr 07 17:25:07.271182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 289/566] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:07.841558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:07.842249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:07.848769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:07.849192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:07.849953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:07.850387 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:07.980307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:07.988043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e8779a71-2170-414e-8587-381b769cfa7b tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1361 microversion: 2.1 time: 0.150603 Apr 07 17:25:07.988595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 278/567] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:07 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:08.282496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4f88d450-d827-4769-a90c-cc129c20f500 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:08.283600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4f88d450-d827-4769-a90c-cc129c20f500 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:08.290907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f88d450-d827-4769-a90c-cc129c20f500 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:08.292321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f88d450-d827-4769-a90c-cc129c20f500 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:08.292321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f88d450-d827-4769-a90c-cc129c20f500 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:08.292536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f88d450-d827-4769-a90c-cc129c20f500 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:08.323592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4f88d450-d827-4769-a90c-cc129c20f500 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Apr 07 17:25:08.324164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 290/568] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:09.004623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:09.005267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:09.011544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:09.011993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:09.012789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:09.013261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:09.147222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:09.154713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c9fc16f1-6cc2-473e-a7a5-9d2a42d88fdb tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1361 microversion: 2.1 time: 0.154590 Apr 07 17:25:09.155278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 279/569] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:08 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:09.335759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ac063faf-c5e0-448e-93b2-3017c59d0729 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:09.336585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ac063faf-c5e0-448e-93b2-3017c59d0729 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:09.342904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac063faf-c5e0-448e-93b2-3017c59d0729 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:09.343347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac063faf-c5e0-448e-93b2-3017c59d0729 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:09.344134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac063faf-c5e0-448e-93b2-3017c59d0729 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:09.344567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac063faf-c5e0-448e-93b2-3017c59d0729 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:09.371456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ac063faf-c5e0-448e-93b2-3017c59d0729 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039680 Apr 07 17:25:09.371990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 291/570] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:10.171968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:10.172577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:10.179416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:10.179867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:10.180721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:10.181181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:10.312811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:10.321249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e47b5342-2079-4c6e-af4d-2f199681d038 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1361 microversion: 2.1 time: 0.153288 Apr 07 17:25:10.321817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 280/571] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:10 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:10.383511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7ec21fab-b4af-4319-a994-2a75b65069d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:10.384427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7ec21fab-b4af-4319-a994-2a75b65069d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:10.390640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ec21fab-b4af-4319-a994-2a75b65069d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:10.391087 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ec21fab-b4af-4319-a994-2a75b65069d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:10.391850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ec21fab-b4af-4319-a994-2a75b65069d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:10.392292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ec21fab-b4af-4319-a994-2a75b65069d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:10.421477 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7ec21fab-b4af-4319-a994-2a75b65069d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041823 Apr 07 17:25:10.422054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 292/572] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:25:11.338222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:11.338824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:11.345202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:11.345654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:11.346469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:11.346904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:11.433313 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cce5cdfe-8674-442d-96f7-8d7270104133 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:11.434234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cce5cdfe-8674-442d-96f7-8d7270104133 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:11.441730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cce5cdfe-8674-442d-96f7-8d7270104133 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:11.442180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cce5cdfe-8674-442d-96f7-8d7270104133 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:11.442943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cce5cdfe-8674-442d-96f7-8d7270104133 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:11.443378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cce5cdfe-8674-442d-96f7-8d7270104133 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:11.472886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cce5cdfe-8674-442d-96f7-8d7270104133 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043519 Apr 07 17:25:11.473480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 293/573] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:25:11.481693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:11.489212 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9c7d6f80-d588-4030-8e1c-4622ce629922 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1361 microversion: 2.1 time: 0.154809 Apr 07 17:25:11.489777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 281/574] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:11 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:12.158079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-135ecb0b-046e-4bca-a265-0e9882f1178c req-c79f71f6-3e30-465e-a143-1c6c1ac099f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffd683-613d-4c1a-9df2-0250be28226e", "name": "network-vif-plugged", "status": "completed", "tag": "cb147af4-39f2-4945-9290-bc42a9da9fb4"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:25:12.165824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-135ecb0b-046e-4bca-a265-0e9882f1178c req-c79f71f6-3e30-465e-a143-1c6c1ac099f7 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:12.166262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-135ecb0b-046e-4bca-a265-0e9882f1178c req-c79f71f6-3e30-465e-a143-1c6c1ac099f7 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:12.178253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-135ecb0b-046e-4bca-a265-0e9882f1178c req-c79f71f6-3e30-465e-a143-1c6c1ac099f7 service nova] Creating event network-vif-plugged:cb147af4-39f2-4945-9290-bc42a9da9fb4 for instance 19ffd683-613d-4c1a-9df2-0250be28226e on hv-cinder-83699 Apr 07 17:25:12.183221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-135ecb0b-046e-4bca-a265-0e9882f1178c req-c79f71f6-3e30-465e-a143-1c6c1ac099f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028924 Apr 07 17:25:12.183794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 294/575] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:12.484059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-515efde9-3eec-4732-a08e-d4b92ab37c07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:12.484984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-515efde9-3eec-4732-a08e-d4b92ab37c07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:12.491854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-515efde9-3eec-4732-a08e-d4b92ab37c07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:12.492406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-515efde9-3eec-4732-a08e-d4b92ab37c07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:12.493261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-515efde9-3eec-4732-a08e-d4b92ab37c07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:12.493711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-515efde9-3eec-4732-a08e-d4b92ab37c07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:12.506747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:12.507460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:12.514029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:12.514485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:12.515256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:12.515696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:12.525419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-515efde9-3eec-4732-a08e-d4b92ab37c07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Apr 07 17:25:12.525994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 282/576] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:25:12.647301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:12.654972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f85e5e82-0834-414c-a777-b1f95e9e014e tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1361 microversion: 2.1 time: 0.153063 Apr 07 17:25:12.655538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 295/577] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:12 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:25:13.536243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-044aa226-ad0a-4648-b112-19d62dd39850 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:13.537194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-044aa226-ad0a-4648-b112-19d62dd39850 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:13.543586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-044aa226-ad0a-4648-b112-19d62dd39850 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:13.546891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-044aa226-ad0a-4648-b112-19d62dd39850 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:13.546891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-044aa226-ad0a-4648-b112-19d62dd39850 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:13.546891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-044aa226-ad0a-4648-b112-19d62dd39850 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:13.575791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-044aa226-ad0a-4648-b112-19d62dd39850 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043439 Apr 07 17:25:13.576366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 283/578] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:13.671956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:13.672665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:13.680080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:13.680537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:13.681472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:13.681946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:13.817390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:13.824645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bc06dd36-8039-43b6-9889-d650a66ba709 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1361 microversion: 2.1 time: 0.156786 Apr 07 17:25:13.825230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 296/579] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:13 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:14.587129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-64c189a6-597a-4753-aed6-a023bc592efe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:14.588048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-64c189a6-597a-4753-aed6-a023bc592efe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:14.594367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-64c189a6-597a-4753-aed6-a023bc592efe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:14.594817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-64c189a6-597a-4753-aed6-a023bc592efe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:14.595578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-64c189a6-597a-4753-aed6-a023bc592efe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:14.596562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-64c189a6-597a-4753-aed6-a023bc592efe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:14.624594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-64c189a6-597a-4753-aed6-a023bc592efe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041398 Apr 07 17:25:14.625144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 284/580] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:14.841962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:14.842503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:14.849418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:14.849865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:14.850624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:14.851057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:14.991431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:14.997882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-21f5c21c-69ac-42b2-9ad9-e90e871c92f2 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1548 microversion: 2.1 time: 0.159720 Apr 07 17:25:14.998454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 297/581] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:14 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:15.013775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-79891b70-9016-4934-966b-dd8992811430 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:15.014267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-79891b70-9016-4934-966b-dd8992811430 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:15.020717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79891b70-9016-4934-966b-dd8992811430 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:15.021185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79891b70-9016-4934-966b-dd8992811430 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:15.021981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79891b70-9016-4934-966b-dd8992811430 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:15.022419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79891b70-9016-4934-966b-dd8992811430 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:15.102737 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-79891b70-9016-4934-966b-dd8992811430 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092659 Apr 07 17:25:15.103366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 285/582] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Apr 7 17:25:15 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:15.635980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-050d0ecd-0f29-49b0-89ac-e152574ab1a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:15.636900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-050d0ecd-0f29-49b0-89ac-e152574ab1a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:15.642699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-050d0ecd-0f29-49b0-89ac-e152574ab1a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:15.643824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-050d0ecd-0f29-49b0-89ac-e152574ab1a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:15.644781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-050d0ecd-0f29-49b0-89ac-e152574ab1a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:15.645238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-050d0ecd-0f29-49b0-89ac-e152574ab1a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:15.676059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-050d0ecd-0f29-49b0-89ac-e152574ab1a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043904 Apr 07 17:25:15.676666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 298/583] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:16.155569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-dd996737-91cb-4409-933c-1e86cdbece91 req-495fbe45-9998-4aa2-bec5-1ceb461f3ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ffd683-613d-4c1a-9df2-0250be28226e", "tag": "cb147af4-39f2-4945-9290-bc42a9da9fb4"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:25:16.163956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-dd996737-91cb-4409-933c-1e86cdbece91 req-495fbe45-9998-4aa2-bec5-1ceb461f3ed7 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:16.164392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-dd996737-91cb-4409-933c-1e86cdbece91 req-495fbe45-9998-4aa2-bec5-1ceb461f3ed7 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:16.176050 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-dd996737-91cb-4409-933c-1e86cdbece91 req-495fbe45-9998-4aa2-bec5-1ceb461f3ed7 service nova] Creating event network-changed:cb147af4-39f2-4945-9290-bc42a9da9fb4 for instance 19ffd683-613d-4c1a-9df2-0250be28226e on hv-cinder-83699 Apr 07 17:25:16.180810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-dd996737-91cb-4409-933c-1e86cdbece91 req-495fbe45-9998-4aa2-bec5-1ceb461f3ed7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087595 Apr 07 17:25:16.181432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 286/584] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:16.688191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-076a687f-8cac-4272-a66f-c7faad96cad5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:16.691351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-076a687f-8cac-4272-a66f-c7faad96cad5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:16.699524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-076a687f-8cac-4272-a66f-c7faad96cad5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:16.700566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-076a687f-8cac-4272-a66f-c7faad96cad5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:16.701997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-076a687f-8cac-4272-a66f-c7faad96cad5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:16.702436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-076a687f-8cac-4272-a66f-c7faad96cad5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:16.735825 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-076a687f-8cac-4272-a66f-c7faad96cad5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052045 Apr 07 17:25:16.736699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 299/585] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:17.748597 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2318dfd0-bc26-4f5c-82fb-71a307d51151 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:17.749626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2318dfd0-bc26-4f5c-82fb-71a307d51151 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:17.755732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2318dfd0-bc26-4f5c-82fb-71a307d51151 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:17.756172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2318dfd0-bc26-4f5c-82fb-71a307d51151 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:17.756921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2318dfd0-bc26-4f5c-82fb-71a307d51151 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:17.757375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2318dfd0-bc26-4f5c-82fb-71a307d51151 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:17.785829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2318dfd0-bc26-4f5c-82fb-71a307d51151 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Apr 07 17:25:17.786356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 287/586] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:18.797361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b76bb923-0cb3-4395-90c1-88d19c81455c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:18.798286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b76bb923-0cb3-4395-90c1-88d19c81455c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:18.805175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b76bb923-0cb3-4395-90c1-88d19c81455c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:18.805626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b76bb923-0cb3-4395-90c1-88d19c81455c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:18.806394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b76bb923-0cb3-4395-90c1-88d19c81455c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:18.806831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b76bb923-0cb3-4395-90c1-88d19c81455c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:18.834929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b76bb923-0cb3-4395-90c1-88d19c81455c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041663 Apr 07 17:25:18.835471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 300/587] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:19.847224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2eb75e40-5919-42ba-9155-7e2ebcc75c54 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:19.848162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2eb75e40-5919-42ba-9155-7e2ebcc75c54 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:19.854367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2eb75e40-5919-42ba-9155-7e2ebcc75c54 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:19.854812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2eb75e40-5919-42ba-9155-7e2ebcc75c54 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:19.855565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2eb75e40-5919-42ba-9155-7e2ebcc75c54 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:19.855994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2eb75e40-5919-42ba-9155-7e2ebcc75c54 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:19.884518 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2eb75e40-5919-42ba-9155-7e2ebcc75c54 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041620 Apr 07 17:25:19.892483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 288/588] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:20.902495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0dad2ce2-b1f0-4cad-b106-be1de82d8b05 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:20.903491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0dad2ce2-b1f0-4cad-b106-be1de82d8b05 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:20.910024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0dad2ce2-b1f0-4cad-b106-be1de82d8b05 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:20.910474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0dad2ce2-b1f0-4cad-b106-be1de82d8b05 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:20.911235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0dad2ce2-b1f0-4cad-b106-be1de82d8b05 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:20.911671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0dad2ce2-b1f0-4cad-b106-be1de82d8b05 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:20.939543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0dad2ce2-b1f0-4cad-b106-be1de82d8b05 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041215 Apr 07 17:25:20.940084 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 301/589] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:21.951864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3d7877d8-e7db-4ef9-a022-e643ca66aaba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:21.952773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3d7877d8-e7db-4ef9-a022-e643ca66aaba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:21.959864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d7877d8-e7db-4ef9-a022-e643ca66aaba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:21.960306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d7877d8-e7db-4ef9-a022-e643ca66aaba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:21.961060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d7877d8-e7db-4ef9-a022-e643ca66aaba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:21.961517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d7877d8-e7db-4ef9-a022-e643ca66aaba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:21.988332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3d7877d8-e7db-4ef9-a022-e643ca66aaba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040449 Apr 07 17:25:21.988870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 289/590] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:22.999784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0fadc167-d4f8-41bf-b18a-616833a313af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:23.000703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0fadc167-d4f8-41bf-b18a-616833a313af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:23.007592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fadc167-d4f8-41bf-b18a-616833a313af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:23.008038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fadc167-d4f8-41bf-b18a-616833a313af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:23.008808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fadc167-d4f8-41bf-b18a-616833a313af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:23.009268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fadc167-d4f8-41bf-b18a-616833a313af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:23.037067 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0fadc167-d4f8-41bf-b18a-616833a313af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041233 Apr 07 17:25:23.037652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 302/591] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:24.047971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9aafefeb-0379-41d2-b605-e52641b4c408 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:24.048905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9aafefeb-0379-41d2-b605-e52641b4c408 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:24.056352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9aafefeb-0379-41d2-b605-e52641b4c408 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:24.056798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9aafefeb-0379-41d2-b605-e52641b4c408 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:24.057580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9aafefeb-0379-41d2-b605-e52641b4c408 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:24.058011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9aafefeb-0379-41d2-b605-e52641b4c408 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:24.085907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9aafefeb-0379-41d2-b605-e52641b4c408 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041868 Apr 07 17:25:24.086442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 290/592] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:25.098466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-687c7aa5-6427-4bd4-bcb2-e81b53825212 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:25.099376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-687c7aa5-6427-4bd4-bcb2-e81b53825212 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:25.105710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-687c7aa5-6427-4bd4-bcb2-e81b53825212 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:25.106150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-687c7aa5-6427-4bd4-bcb2-e81b53825212 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:25.106911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-687c7aa5-6427-4bd4-bcb2-e81b53825212 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:25.107342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-687c7aa5-6427-4bd4-bcb2-e81b53825212 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:25.137202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-687c7aa5-6427-4bd4-bcb2-e81b53825212 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043635 Apr 07 17:25:25.138081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 303/593] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:26.150292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-50ca9299-f2a3-43fd-be3a-9ff85d3d2e19 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:26.151249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-50ca9299-f2a3-43fd-be3a-9ff85d3d2e19 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:26.157757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ca9299-f2a3-43fd-be3a-9ff85d3d2e19 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:26.158206 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ca9299-f2a3-43fd-be3a-9ff85d3d2e19 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:26.159635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ca9299-f2a3-43fd-be3a-9ff85d3d2e19 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:26.160127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ca9299-f2a3-43fd-be3a-9ff85d3d2e19 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:26.188941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-50ca9299-f2a3-43fd-be3a-9ff85d3d2e19 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042794 Apr 07 17:25:26.189544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 291/594] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:27.200160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-63401191-55fe-418e-9e48-b95d71ea3932 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:27.201155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-63401191-55fe-418e-9e48-b95d71ea3932 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:27.208733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63401191-55fe-418e-9e48-b95d71ea3932 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:27.209204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63401191-55fe-418e-9e48-b95d71ea3932 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:27.210001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63401191-55fe-418e-9e48-b95d71ea3932 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:27.210523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63401191-55fe-418e-9e48-b95d71ea3932 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:27.238960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-63401191-55fe-418e-9e48-b95d71ea3932 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042887 Apr 07 17:25:27.239509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 304/595] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:28.250551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8f624cfe-1e91-453d-a9c5-90d691405e06 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:28.251461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8f624cfe-1e91-453d-a9c5-90d691405e06 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:28.257732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f624cfe-1e91-453d-a9c5-90d691405e06 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:28.258174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f624cfe-1e91-453d-a9c5-90d691405e06 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:28.258924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f624cfe-1e91-453d-a9c5-90d691405e06 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:28.259353 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f624cfe-1e91-453d-a9c5-90d691405e06 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:28.288058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8f624cfe-1e91-453d-a9c5-90d691405e06 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Apr 07 17:25:28.288594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 292/596] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:29.299443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-52577599-7a42-4897-93e1-4fcae68f6521 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:29.300321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-52577599-7a42-4897-93e1-4fcae68f6521 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:29.306712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-52577599-7a42-4897-93e1-4fcae68f6521 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:29.307160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-52577599-7a42-4897-93e1-4fcae68f6521 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:29.307924 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-52577599-7a42-4897-93e1-4fcae68f6521 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:29.308359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-52577599-7a42-4897-93e1-4fcae68f6521 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:29.337400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-52577599-7a42-4897-93e1-4fcae68f6521 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042002 Apr 07 17:25:29.337962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 305/597] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:30.348501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e9bbcbf9-55a6-4c19-8efc-5e7e142ac3f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:30.349442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e9bbcbf9-55a6-4c19-8efc-5e7e142ac3f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:30.355677 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9bbcbf9-55a6-4c19-8efc-5e7e142ac3f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:30.356122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9bbcbf9-55a6-4c19-8efc-5e7e142ac3f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:30.356878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9bbcbf9-55a6-4c19-8efc-5e7e142ac3f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:30.357345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9bbcbf9-55a6-4c19-8efc-5e7e142ac3f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:30.385778 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e9bbcbf9-55a6-4c19-8efc-5e7e142ac3f5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041804 Apr 07 17:25:30.386325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 293/598] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:25:31.397958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-962fa4a5-8ab9-499b-9a7f-f12e03fe1c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:31.399158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-962fa4a5-8ab9-499b-9a7f-f12e03fe1c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:31.405227 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-962fa4a5-8ab9-499b-9a7f-f12e03fe1c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:31.405618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-962fa4a5-8ab9-499b-9a7f-f12e03fe1c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:31.406384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-962fa4a5-8ab9-499b-9a7f-f12e03fe1c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:31.406824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-962fa4a5-8ab9-499b-9a7f-f12e03fe1c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:31.439030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-962fa4a5-8ab9-499b-9a7f-f12e03fe1c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Apr 07 17:25:31.439588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 306/599] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:32.450813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ea5eb3ce-bb91-4f21-9341-6fdcf0857c9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:32.451729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ea5eb3ce-bb91-4f21-9341-6fdcf0857c9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:32.458929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea5eb3ce-bb91-4f21-9341-6fdcf0857c9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:32.459374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea5eb3ce-bb91-4f21-9341-6fdcf0857c9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:32.460130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea5eb3ce-bb91-4f21-9341-6fdcf0857c9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:32.460565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea5eb3ce-bb91-4f21-9341-6fdcf0857c9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:32.487667 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ea5eb3ce-bb91-4f21-9341-6fdcf0857c9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040873 Apr 07 17:25:32.488202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 294/600] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:33.498949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-991d4778-b035-408d-96e5-68c29179113f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:33.499814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-991d4778-b035-408d-96e5-68c29179113f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:33.506916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-991d4778-b035-408d-96e5-68c29179113f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:33.507369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-991d4778-b035-408d-96e5-68c29179113f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:33.508127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-991d4778-b035-408d-96e5-68c29179113f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:33.508567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-991d4778-b035-408d-96e5-68c29179113f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:33.536690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-991d4778-b035-408d-96e5-68c29179113f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041746 Apr 07 17:25:33.537269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 307/601] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:34.547713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d808fb62-be4c-461e-afc8-62bbf9b037fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:34.548619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d808fb62-be4c-461e-afc8-62bbf9b037fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:34.555672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d808fb62-be4c-461e-afc8-62bbf9b037fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:34.556114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d808fb62-be4c-461e-afc8-62bbf9b037fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:34.556869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d808fb62-be4c-461e-afc8-62bbf9b037fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:34.557339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d808fb62-be4c-461e-afc8-62bbf9b037fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:34.585507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d808fb62-be4c-461e-afc8-62bbf9b037fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 Apr 07 17:25:34.586052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 295/602] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:35.597095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2ddaa218-6273-4541-bf5e-de5bb4a09e67 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:35.598308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2ddaa218-6273-4541-bf5e-de5bb4a09e67 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:35.604972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ddaa218-6273-4541-bf5e-de5bb4a09e67 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:35.605460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ddaa218-6273-4541-bf5e-de5bb4a09e67 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:35.606257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ddaa218-6273-4541-bf5e-de5bb4a09e67 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:35.606752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ddaa218-6273-4541-bf5e-de5bb4a09e67 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:35.635604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2ddaa218-6273-4541-bf5e-de5bb4a09e67 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 Apr 07 17:25:35.636158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 308/603] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:36.647943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-276829b3-f8d9-4dd8-ba7f-48c1d4c34950 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:36.649108 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-276829b3-f8d9-4dd8-ba7f-48c1d4c34950 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:36.655422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276829b3-f8d9-4dd8-ba7f-48c1d4c34950 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:36.655863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276829b3-f8d9-4dd8-ba7f-48c1d4c34950 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:36.656621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276829b3-f8d9-4dd8-ba7f-48c1d4c34950 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:36.657045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276829b3-f8d9-4dd8-ba7f-48c1d4c34950 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:36.685986 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-276829b3-f8d9-4dd8-ba7f-48c1d4c34950 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042727 Apr 07 17:25:36.686526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 296/604] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:37.697512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3e03d128-2300-4691-859c-a1c3ffdb10aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:37.698429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3e03d128-2300-4691-859c-a1c3ffdb10aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:37.704623 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e03d128-2300-4691-859c-a1c3ffdb10aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:37.705066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e03d128-2300-4691-859c-a1c3ffdb10aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:37.705860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e03d128-2300-4691-859c-a1c3ffdb10aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:37.706291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e03d128-2300-4691-859c-a1c3ffdb10aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:37.734330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3e03d128-2300-4691-859c-a1c3ffdb10aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040733 Apr 07 17:25:37.734866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 309/605] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:38.745711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-90a24ba5-e2d9-4de2-a95a-621e6a2e7dc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:38.746662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-90a24ba5-e2d9-4de2-a95a-621e6a2e7dc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:38.752914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a24ba5-e2d9-4de2-a95a-621e6a2e7dc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:38.753514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a24ba5-e2d9-4de2-a95a-621e6a2e7dc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:38.754303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a24ba5-e2d9-4de2-a95a-621e6a2e7dc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:38.754935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a24ba5-e2d9-4de2-a95a-621e6a2e7dc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:38.783307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-90a24ba5-e2d9-4de2-a95a-621e6a2e7dc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041541 Apr 07 17:25:38.783857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 297/606] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:39.795812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a13e2dcd-51cf-4ffd-bc8c-67050479ba09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:39.796722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a13e2dcd-51cf-4ffd-bc8c-67050479ba09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:39.803422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a13e2dcd-51cf-4ffd-bc8c-67050479ba09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:39.803866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a13e2dcd-51cf-4ffd-bc8c-67050479ba09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:39.804617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a13e2dcd-51cf-4ffd-bc8c-67050479ba09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:39.805526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a13e2dcd-51cf-4ffd-bc8c-67050479ba09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:39.834575 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a13e2dcd-51cf-4ffd-bc8c-67050479ba09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042651 Apr 07 17:25:39.835127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 310/607] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:40.846410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f4218a6e-7e3e-4a8f-8014-fcbfd6cb121b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:40.847880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f4218a6e-7e3e-4a8f-8014-fcbfd6cb121b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:40.854378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4218a6e-7e3e-4a8f-8014-fcbfd6cb121b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:40.854825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4218a6e-7e3e-4a8f-8014-fcbfd6cb121b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:40.855586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4218a6e-7e3e-4a8f-8014-fcbfd6cb121b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:40.856014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f4218a6e-7e3e-4a8f-8014-fcbfd6cb121b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:40.884523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f4218a6e-7e3e-4a8f-8014-fcbfd6cb121b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042130 Apr 07 17:25:40.888546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 298/608] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:41.896248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a65d7717-be69-4b54-91fa-9ba13bb93f2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:41.897253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a65d7717-be69-4b54-91fa-9ba13bb93f2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:41.904199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a65d7717-be69-4b54-91fa-9ba13bb93f2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:41.904589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a65d7717-be69-4b54-91fa-9ba13bb93f2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:41.905391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a65d7717-be69-4b54-91fa-9ba13bb93f2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:41.905829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a65d7717-be69-4b54-91fa-9ba13bb93f2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:41.934348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a65d7717-be69-4b54-91fa-9ba13bb93f2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042341 Apr 07 17:25:41.934897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 311/609] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:42.946361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-22cead2d-e1e6-4419-aa75-66eb16404c8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:42.947279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-22cead2d-e1e6-4419-aa75-66eb16404c8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:42.953606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22cead2d-e1e6-4419-aa75-66eb16404c8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:42.954049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22cead2d-e1e6-4419-aa75-66eb16404c8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:42.954804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22cead2d-e1e6-4419-aa75-66eb16404c8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:42.955235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22cead2d-e1e6-4419-aa75-66eb16404c8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:42.983758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-22cead2d-e1e6-4419-aa75-66eb16404c8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041450 Apr 07 17:25:42.984304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 299/610] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:43.996016 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f15b2a2f-db2c-4de9-b438-2a8046d7a78d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:43.996940 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f15b2a2f-db2c-4de9-b438-2a8046d7a78d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:44.003943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f15b2a2f-db2c-4de9-b438-2a8046d7a78d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:44.004478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f15b2a2f-db2c-4de9-b438-2a8046d7a78d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:44.005281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f15b2a2f-db2c-4de9-b438-2a8046d7a78d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:44.005724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f15b2a2f-db2c-4de9-b438-2a8046d7a78d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:44.033382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f15b2a2f-db2c-4de9-b438-2a8046d7a78d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041336 Apr 07 17:25:44.033926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 312/611] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:45.045432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-90a99060-0766-4f95-86fa-6063871e8ef0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:45.046373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-90a99060-0766-4f95-86fa-6063871e8ef0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:45.052867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a99060-0766-4f95-86fa-6063871e8ef0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:45.053367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a99060-0766-4f95-86fa-6063871e8ef0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:45.054376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a99060-0766-4f95-86fa-6063871e8ef0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:45.054822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90a99060-0766-4f95-86fa-6063871e8ef0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:45.083454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-90a99060-0766-4f95-86fa-6063871e8ef0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042011 Apr 07 17:25:45.083996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 300/612] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:46.094929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-239bb566-1c9d-4875-adb5-214477246f4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:46.095850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-239bb566-1c9d-4875-adb5-214477246f4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:46.102109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-239bb566-1c9d-4875-adb5-214477246f4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:46.102555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-239bb566-1c9d-4875-adb5-214477246f4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:46.103319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-239bb566-1c9d-4875-adb5-214477246f4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:46.103754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-239bb566-1c9d-4875-adb5-214477246f4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:46.131735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-239bb566-1c9d-4875-adb5-214477246f4c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040697 Apr 07 17:25:46.132275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 313/613] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:47.144141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-aa381d3a-f62f-44c7-b7f5-74ac7ef080d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:47.145404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-aa381d3a-f62f-44c7-b7f5-74ac7ef080d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:47.151994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aa381d3a-f62f-44c7-b7f5-74ac7ef080d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:47.152436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aa381d3a-f62f-44c7-b7f5-74ac7ef080d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:47.153223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aa381d3a-f62f-44c7-b7f5-74ac7ef080d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:47.153658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aa381d3a-f62f-44c7-b7f5-74ac7ef080d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:47.182427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-aa381d3a-f62f-44c7-b7f5-74ac7ef080d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043112 Apr 07 17:25:47.182971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 301/614] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:48.194324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-84ac6aec-efe6-4f22-bc2c-a2b6a616a67c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:48.195238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-84ac6aec-efe6-4f22-bc2c-a2b6a616a67c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:48.201988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84ac6aec-efe6-4f22-bc2c-a2b6a616a67c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:48.202429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84ac6aec-efe6-4f22-bc2c-a2b6a616a67c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:48.203187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84ac6aec-efe6-4f22-bc2c-a2b6a616a67c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:48.203616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84ac6aec-efe6-4f22-bc2c-a2b6a616a67c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:48.232082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-84ac6aec-efe6-4f22-bc2c-a2b6a616a67c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041975 Apr 07 17:25:48.232618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 314/615] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:49.244233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3dc9fc98-ab82-4af7-b82d-9594c7ba7f6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:49.245171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3dc9fc98-ab82-4af7-b82d-9594c7ba7f6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:49.251517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dc9fc98-ab82-4af7-b82d-9594c7ba7f6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:49.251960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dc9fc98-ab82-4af7-b82d-9594c7ba7f6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:49.252725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dc9fc98-ab82-4af7-b82d-9594c7ba7f6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:49.253217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dc9fc98-ab82-4af7-b82d-9594c7ba7f6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:49.281938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3dc9fc98-ab82-4af7-b82d-9594c7ba7f6b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Apr 07 17:25:49.282483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 302/616] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:50.293582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-63d335b8-9adb-44be-9954-8d0d35464f5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:50.294489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-63d335b8-9adb-44be-9954-8d0d35464f5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:50.300737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63d335b8-9adb-44be-9954-8d0d35464f5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:50.301717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63d335b8-9adb-44be-9954-8d0d35464f5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:50.302514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63d335b8-9adb-44be-9954-8d0d35464f5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:50.302952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63d335b8-9adb-44be-9954-8d0d35464f5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:50.331344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-63d335b8-9adb-44be-9954-8d0d35464f5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041772 Apr 07 17:25:50.332709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 315/617] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:50.955796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-800a544e-c411-4103-ade0-e7b57bf5b37c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:50.956332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-800a544e-c411-4103-ade0-e7b57bf5b37c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:50.962827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-800a544e-c411-4103-ade0-e7b57bf5b37c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:50.963272 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-800a544e-c411-4103-ade0-e7b57bf5b37c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:50.964033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-800a544e-c411-4103-ade0-e7b57bf5b37c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:50.964463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-800a544e-c411-4103-ade0-e7b57bf5b37c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:50.987147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-800a544e-c411-4103-ade0-e7b57bf5b37c tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e/ips" status: 200 len: 147 microversion: 2.1 time: 0.035263 Apr 07 17:25:50.987711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 303/618] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:25:50 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:51.343133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c9afa294-0b67-4578-8311-fa0d4bc6d68c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:51.344083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c9afa294-0b67-4578-8311-fa0d4bc6d68c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:51.350771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9afa294-0b67-4578-8311-fa0d4bc6d68c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:51.351216 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9afa294-0b67-4578-8311-fa0d4bc6d68c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:51.351992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9afa294-0b67-4578-8311-fa0d4bc6d68c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:51.352482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9afa294-0b67-4578-8311-fa0d4bc6d68c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:51.386136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c9afa294-0b67-4578-8311-fa0d4bc6d68c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047072 Apr 07 17:25:51.386949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 316/619] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:52.398882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c8b11551-0d0e-4bb4-99d8-ce9dc7a3fa26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:52.399793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c8b11551-0d0e-4bb4-99d8-ce9dc7a3fa26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:52.406001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b11551-0d0e-4bb4-99d8-ce9dc7a3fa26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:52.406445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b11551-0d0e-4bb4-99d8-ce9dc7a3fa26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:52.407196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b11551-0d0e-4bb4-99d8-ce9dc7a3fa26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:52.407625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8b11551-0d0e-4bb4-99d8-ce9dc7a3fa26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:52.436535 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c8b11551-0d0e-4bb4-99d8-ce9dc7a3fa26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042773 Apr 07 17:25:52.437089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 304/620] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:53.137347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:53.137945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:53.144085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:53.145213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:53.146100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:53.146540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:53.170453 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:25:53.374375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a611690c-1082-4890-a702-f0e4e3e48da4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "DELETE /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 204 len: 0 microversion: 2.1 time: 0.240593 Apr 07 17:25:53.374978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 317/621] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:25:53 2022] DELETE /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:25:53.383698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:53.385832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:53.390779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:53.391161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:53.391932 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:53.392366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:53.450345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8971506f-55a1-483a-a10b-a86815debb90 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:53.451376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8971506f-55a1-483a-a10b-a86815debb90 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:53.458618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8971506f-55a1-483a-a10b-a86815debb90 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:53.459048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8971506f-55a1-483a-a10b-a86815debb90 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:53.459966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8971506f-55a1-483a-a10b-a86815debb90 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:53.460401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8971506f-55a1-483a-a10b-a86815debb90 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:53.495770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8971506f-55a1-483a-a10b-a86815debb90 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050313 Apr 07 17:25:53.496988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 318/622] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:25:53.554335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:53.562043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-982a86e3-3ff9-4b77-a89c-3c720b5742c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1576 microversion: 2.1 time: 0.182178 Apr 07 17:25:53.562639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 305/623] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:54.508332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-febee631-cda4-4e9c-bea0-1a549e29929b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:54.509272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-febee631-cda4-4e9c-bea0-1a549e29929b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:54.515535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-febee631-cda4-4e9c-bea0-1a549e29929b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:54.515987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-febee631-cda4-4e9c-bea0-1a549e29929b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:54.516751 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-febee631-cda4-4e9c-bea0-1a549e29929b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:54.517221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-febee631-cda4-4e9c-bea0-1a549e29929b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:54.546418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-febee631-cda4-4e9c-bea0-1a549e29929b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042824 Apr 07 17:25:54.546971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 319/624] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:54.584067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:54.584691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:54.591096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:54.591548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:54.592325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:54.593131 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:54.731229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:54.740403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-49086fde-042c-4f14-92c4-e8b58f1b812a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1576 microversion: 2.1 time: 0.160471 Apr 07 17:25:54.740884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 306/625] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:54 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:55.557768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-22de9fdd-eb57-4cb5-8933-37df59822b99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:55.558602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-22de9fdd-eb57-4cb5-8933-37df59822b99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:55.564851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22de9fdd-eb57-4cb5-8933-37df59822b99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:55.565343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22de9fdd-eb57-4cb5-8933-37df59822b99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:55.566110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22de9fdd-eb57-4cb5-8933-37df59822b99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:55.567049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22de9fdd-eb57-4cb5-8933-37df59822b99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:55.595822 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-22de9fdd-eb57-4cb5-8933-37df59822b99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042029 Apr 07 17:25:55.596379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 320/626] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:55.759253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:55.759869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:55.766154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:55.766600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:55.767360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:55.767792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:55.913970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:55.922694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b4324507-8fa4-49a9-a7ac-7ddcfb0a6586 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1576 microversion: 2.1 time: 0.167166 Apr 07 17:25:55.926469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 307/627] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:56.177673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-6fbf7f97-0839-40fb-9750-56e3addd119f req-05a4c58b-4a6c-4b29-bb56-aed79b67a7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29493f81-0b41-4e00-9b9a-08301cc1d2b0", "name": "network-vif-deleted", "tag": "31cf2729-37f3-484c-bad0-abb9ba907dcd"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:25:56.185517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-6fbf7f97-0839-40fb-9750-56e3addd119f req-05a4c58b-4a6c-4b29-bb56-aed79b67a7e0 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:56.187159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-6fbf7f97-0839-40fb-9750-56e3addd119f req-05a4c58b-4a6c-4b29-bb56-aed79b67a7e0 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:56.196975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-6fbf7f97-0839-40fb-9750-56e3addd119f req-05a4c58b-4a6c-4b29-bb56-aed79b67a7e0 service nova] Creating event network-vif-deleted:31cf2729-37f3-484c-bad0-abb9ba907dcd for instance 29493f81-0b41-4e00-9b9a-08301cc1d2b0 on hv-cinder-83699 Apr 07 17:25:56.202097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-6fbf7f97-0839-40fb-9750-56e3addd119f req-05a4c58b-4a6c-4b29-bb56-aed79b67a7e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028506 Apr 07 17:25:56.202685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 321/628] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:56.607539 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a285120e-4358-4694-8e7f-53dca9c5cbb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:56.608517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a285120e-4358-4694-8e7f-53dca9c5cbb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:56.615176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a285120e-4358-4694-8e7f-53dca9c5cbb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:56.615684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a285120e-4358-4694-8e7f-53dca9c5cbb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:56.616457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a285120e-4358-4694-8e7f-53dca9c5cbb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:56.616891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a285120e-4358-4694-8e7f-53dca9c5cbb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:56.647555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a285120e-4358-4694-8e7f-53dca9c5cbb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Apr 07 17:25:56.651615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 308/629] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:56.940714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:56.942181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:56.948430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:56.948876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:56.949660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:56.950092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:57.009897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:57.017027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-04f4b489-5c3a-4e41-abdb-8e6b0998f8e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080550 Apr 07 17:25:57.017833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 322/630] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:57.659723 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-054d1c56-eb11-46a7-a417-6975759a7a25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:57.660692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-054d1c56-eb11-46a7-a417-6975759a7a25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:57.668227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-054d1c56-eb11-46a7-a417-6975759a7a25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:57.668975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-054d1c56-eb11-46a7-a417-6975759a7a25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:57.669826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-054d1c56-eb11-46a7-a417-6975759a7a25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:57.670265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-054d1c56-eb11-46a7-a417-6975759a7a25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:57.701278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-054d1c56-eb11-46a7-a417-6975759a7a25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045742 Apr 07 17:25:57.701827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 309/631] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:25:58.036589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:58.037233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:58.045182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:58.045925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:58.047206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:58.047936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:58.114596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:58.122028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e87a03ea-4653-45f0-a7f5-a848598ffb59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.091555 Apr 07 17:25:58.122589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 323/632] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:58.712744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-12c1b2a6-599a-4739-b131-65732d90dec6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:58.713747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-12c1b2a6-599a-4739-b131-65732d90dec6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:58.720364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-12c1b2a6-599a-4739-b131-65732d90dec6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:58.720807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-12c1b2a6-599a-4739-b131-65732d90dec6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:58.721596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-12c1b2a6-599a-4739-b131-65732d90dec6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:58.722031 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-12c1b2a6-599a-4739-b131-65732d90dec6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:58.749906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-12c1b2a6-599a-4739-b131-65732d90dec6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041155 Apr 07 17:25:58.750463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 310/633] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:25:59.142633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:59.143248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:59.150096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:59.150547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:59.151310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:59.151748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:59.209766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:25:59.217057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d60cb51a-3fbb-4b96-93cf-24e536d5b17c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078270 Apr 07 17:25:59.217652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 324/634] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:25:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:25:59.762117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-181b639e-7ea2-4586-8a5d-41722b5b32cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:25:59.763033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-181b639e-7ea2-4586-8a5d-41722b5b32cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:25:59.769928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-181b639e-7ea2-4586-8a5d-41722b5b32cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:59.770420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-181b639e-7ea2-4586-8a5d-41722b5b32cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:59.771188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-181b639e-7ea2-4586-8a5d-41722b5b32cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:25:59.771627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-181b639e-7ea2-4586-8a5d-41722b5b32cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:25:59.800023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-181b639e-7ea2-4586-8a5d-41722b5b32cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041875 Apr 07 17:25:59.800581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 311/635] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:25:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:00.234175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:00.234804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:00.241664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:00.242105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:00.242904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:00.243336 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:00.302127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:00.309327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d19187ea-5864-4deb-a11e-86b9b0dbf037 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078970 Apr 07 17:26:00.309888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 325/636] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:00.811054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9cd59e7e-004b-4aa6-b8a5-7bf775c15016 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:00.811970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9cd59e7e-004b-4aa6-b8a5-7bf775c15016 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:00.818530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cd59e7e-004b-4aa6-b8a5-7bf775c15016 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:00.818972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cd59e7e-004b-4aa6-b8a5-7bf775c15016 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:00.819772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cd59e7e-004b-4aa6-b8a5-7bf775c15016 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:00.820205 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cd59e7e-004b-4aa6-b8a5-7bf775c15016 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:00.849540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9cd59e7e-004b-4aa6-b8a5-7bf775c15016 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 Apr 07 17:26:00.850075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 312/637] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:01.326475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:01.327079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:01.333814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:01.334262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:01.335020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:01.335453 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:01.392784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:01.400907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0ea30acc-290e-470f-aac7-f8973311ee55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078536 Apr 07 17:26:01.401501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 326/638] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:01.860326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e678f109-2ba0-4deb-8c20-ecda4278b51d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:01.861265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e678f109-2ba0-4deb-8c20-ecda4278b51d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:01.868204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e678f109-2ba0-4deb-8c20-ecda4278b51d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:01.868652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e678f109-2ba0-4deb-8c20-ecda4278b51d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:01.869443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e678f109-2ba0-4deb-8c20-ecda4278b51d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:01.869881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e678f109-2ba0-4deb-8c20-ecda4278b51d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:01.897962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e678f109-2ba0-4deb-8c20-ecda4278b51d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041601 Apr 07 17:26:01.898771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 313/639] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:02.418038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:02.418648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:02.424909 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:02.425393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:02.426148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:02.426577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:02.487437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:02.495275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-81c8f4fc-946d-48fe-b33b-abbd68618428 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081251 Apr 07 17:26:02.495831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 327/640] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:02 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:02.910401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-88b81d1f-48d8-42ea-a051-0b6b3f967fe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:02.911362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-88b81d1f-48d8-42ea-a051-0b6b3f967fe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:02.917632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b81d1f-48d8-42ea-a051-0b6b3f967fe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:02.921483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b81d1f-48d8-42ea-a051-0b6b3f967fe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:02.921483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b81d1f-48d8-42ea-a051-0b6b3f967fe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:02.921483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b81d1f-48d8-42ea-a051-0b6b3f967fe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:02.948629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-88b81d1f-48d8-42ea-a051-0b6b3f967fe0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042775 Apr 07 17:26:02.949414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 314/641] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:03.511942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:03.512480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:03.518980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:03.519622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:03.520436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:03.520869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:03.580630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:03.588260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dbdcd5fd-50e3-40c7-b623-054bd2ababdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080278 Apr 07 17:26:03.588828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 328/642] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:03.960916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3de93436-c98b-43dd-9a38-828ec33ac6b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:03.961866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3de93436-c98b-43dd-9a38-828ec33ac6b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:03.968044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3de93436-c98b-43dd-9a38-828ec33ac6b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:03.968482 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3de93436-c98b-43dd-9a38-828ec33ac6b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:03.969403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3de93436-c98b-43dd-9a38-828ec33ac6b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:03.969833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3de93436-c98b-43dd-9a38-828ec33ac6b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:03.997113 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3de93436-c98b-43dd-9a38-828ec33ac6b9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041165 Apr 07 17:26:03.997672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 315/643] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:04.605183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:04.605789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:04.612034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:04.612477 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:04.613986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:04.614301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:04.673355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:04.681556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-eb2c0bd8-ec0b-477f-bc63-7d88950ed65e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080203 Apr 07 17:26:04.682118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 329/644] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:04 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:05.008159 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c6b8a48-fa6b-406e-9a73-ce00e289028c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:05.009077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5c6b8a48-fa6b-406e-9a73-ce00e289028c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:05.015112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a48-fa6b-406e-9a73-ce00e289028c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:05.015565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a48-fa6b-406e-9a73-ce00e289028c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:05.016328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a48-fa6b-406e-9a73-ce00e289028c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:05.016765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6b8a48-fa6b-406e-9a73-ce00e289028c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:05.045629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5c6b8a48-fa6b-406e-9a73-ce00e289028c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Apr 07 17:26:05.046196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 316/645] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:05.698179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:05.698819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:05.705126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:05.705607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:05.706376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:05.707428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:05.767589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:05.775950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2571ea02-3172-4b21-b9b2-0203abf0933c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081692 Apr 07 17:26:05.776518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 330/646] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:05 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:06.057475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-07085296-51cf-4067-9e17-3b4165adfba5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:06.058396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-07085296-51cf-4067-9e17-3b4165adfba5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:06.064613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07085296-51cf-4067-9e17-3b4165adfba5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:06.065061 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07085296-51cf-4067-9e17-3b4165adfba5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:06.065852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07085296-51cf-4067-9e17-3b4165adfba5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:06.066817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-07085296-51cf-4067-9e17-3b4165adfba5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:06.096745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-07085296-51cf-4067-9e17-3b4165adfba5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Apr 07 17:26:06.097329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 317/647] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:06.793468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:06.794071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:06.800951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:06.801429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:06.802196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:06.802633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:06.860824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:06.868857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-12e59b76-eb57-48c6-9b3a-a2bce8bdded5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079298 Apr 07 17:26:06.869452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 331/648] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:06 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:07.107947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fbdf3ec8-91b4-47e5-a6d9-4506308a5e66 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:07.108982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fbdf3ec8-91b4-47e5-a6d9-4506308a5e66 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:07.115906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbdf3ec8-91b4-47e5-a6d9-4506308a5e66 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:07.116346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbdf3ec8-91b4-47e5-a6d9-4506308a5e66 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:07.117100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbdf3ec8-91b4-47e5-a6d9-4506308a5e66 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:07.117555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbdf3ec8-91b4-47e5-a6d9-4506308a5e66 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:07.146809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fbdf3ec8-91b4-47e5-a6d9-4506308a5e66 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Apr 07 17:26:07.147380 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 318/649] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:07.885778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:07.886388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:07.892584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:07.895411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:07.895411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:07.895411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:07.952712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:07.960659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e2bb1493-d28e-47a7-b93e-a655beba3ec2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078719 Apr 07 17:26:07.961242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 332/650] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:08.158757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e75f9ed9-8d72-4a7b-862e-3d9783f9ae11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:08.159699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e75f9ed9-8d72-4a7b-862e-3d9783f9ae11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:08.166217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75f9ed9-8d72-4a7b-862e-3d9783f9ae11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:08.166666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75f9ed9-8d72-4a7b-862e-3d9783f9ae11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:08.167426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75f9ed9-8d72-4a7b-862e-3d9783f9ae11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:08.167894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e75f9ed9-8d72-4a7b-862e-3d9783f9ae11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:08.196275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e75f9ed9-8d72-4a7b-862e-3d9783f9ae11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041475 Apr 07 17:26:08.196818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 319/651] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:08.977859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:08.978474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:08.984714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:08.985191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:08.985982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:08.986424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:09.047610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:09.055243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0d012205-c283-4baa-bf61-03c57f6e4227 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081220 Apr 07 17:26:09.055812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 333/652] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:09.208803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c94cf3ff-b6e2-4140-86aa-187bffdaed92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:09.209742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c94cf3ff-b6e2-4140-86aa-187bffdaed92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:09.215916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c94cf3ff-b6e2-4140-86aa-187bffdaed92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:09.216356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c94cf3ff-b6e2-4140-86aa-187bffdaed92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:09.217105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c94cf3ff-b6e2-4140-86aa-187bffdaed92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:09.217559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c94cf3ff-b6e2-4140-86aa-187bffdaed92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:09.245628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c94cf3ff-b6e2-4140-86aa-187bffdaed92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041727 Apr 07 17:26:09.246093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 320/653] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:10.072464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:10.073094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:10.079437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:10.079880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:10.080632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:10.081061 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:10.140415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:10.147686 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4baea658-d1b9-4916-99ec-9b4f6554524e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079019 Apr 07 17:26:10.148246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 334/654] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:10.256840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6f376631-552a-419e-830f-82e61cb856cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:10.258615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6f376631-552a-419e-830f-82e61cb856cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:10.264893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6f376631-552a-419e-830f-82e61cb856cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:10.265402 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6f376631-552a-419e-830f-82e61cb856cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:10.266169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6f376631-552a-419e-830f-82e61cb856cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:10.266602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6f376631-552a-419e-830f-82e61cb856cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:10.294076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6f376631-552a-419e-830f-82e61cb856cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041118 Apr 07 17:26:10.294616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 321/655] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:11.165452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:11.166068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:11.172304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:11.172752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:11.173542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:11.173980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:11.234100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:11.241485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-575a6076-cc72-45a3-ba9b-1c21e275e6e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079953 Apr 07 17:26:11.242050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 335/656] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:26:11.305576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8cac5a9d-f53e-4a97-a186-c42ae13c900e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:11.306502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8cac5a9d-f53e-4a97-a186-c42ae13c900e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:11.312734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8cac5a9d-f53e-4a97-a186-c42ae13c900e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:11.313195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8cac5a9d-f53e-4a97-a186-c42ae13c900e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:11.313956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8cac5a9d-f53e-4a97-a186-c42ae13c900e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:11.314382 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8cac5a9d-f53e-4a97-a186-c42ae13c900e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:11.343098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8cac5a9d-f53e-4a97-a186-c42ae13c900e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041494 Apr 07 17:26:11.343643 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 322/657] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:12.258130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:12.258737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:12.265408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:12.265886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:12.266709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:12.267148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:12.325517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:12.333831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-638a3f43-a5a7-410c-8ecb-4be01a2e6fda tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080259 Apr 07 17:26:12.334401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 336/658] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:12.354080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-76372341-2ddb-4c9b-9858-c2de8cac9dc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:12.354994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-76372341-2ddb-4c9b-9858-c2de8cac9dc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:12.361258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76372341-2ddb-4c9b-9858-c2de8cac9dc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:12.361707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76372341-2ddb-4c9b-9858-c2de8cac9dc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:12.362458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76372341-2ddb-4c9b-9858-c2de8cac9dc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:12.363872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76372341-2ddb-4c9b-9858-c2de8cac9dc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:12.391906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-76372341-2ddb-4c9b-9858-c2de8cac9dc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041776 Apr 07 17:26:12.392440 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 323/659] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:13.351516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:13.352183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:13.358553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:13.358995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:13.359758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:13.360187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:13.404730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e9596c92-dc43-4c0d-b790-d6580f5cfb8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:13.405673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e9596c92-dc43-4c0d-b790-d6580f5cfb8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:13.412582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9596c92-dc43-4c0d-b790-d6580f5cfb8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:13.413028 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9596c92-dc43-4c0d-b790-d6580f5cfb8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:13.413822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9596c92-dc43-4c0d-b790-d6580f5cfb8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:13.414260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9596c92-dc43-4c0d-b790-d6580f5cfb8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:13.421462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:13.428747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7db30c1c-6cf6-4105-b05b-c0faec7ebb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082211 Apr 07 17:26:13.429334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 337/660] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:13.442614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e9596c92-dc43-4c0d-b790-d6580f5cfb8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041878 Apr 07 17:26:13.443161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 324/661] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:26:14.446108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:14.446717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:14.453041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:14.453519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:14.453838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fcff0985-c310-47ba-ab1a-277ca5eda6d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:14.454287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:14.454722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:14.454830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fcff0985-c310-47ba-ab1a-277ca5eda6d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:14.462257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fcff0985-c310-47ba-ab1a-277ca5eda6d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:14.462701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fcff0985-c310-47ba-ab1a-277ca5eda6d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:14.463456 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fcff0985-c310-47ba-ab1a-277ca5eda6d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:14.463887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fcff0985-c310-47ba-ab1a-277ca5eda6d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:14.492073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fcff0985-c310-47ba-ab1a-277ca5eda6d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042047 Apr 07 17:26:14.492839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 325/662] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:26:14.514469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:14.522419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-58294ab7-d810-4c2b-87e3-622fd7690a99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080195 Apr 07 17:26:14.522978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 338/663] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:15.502862 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5cbf4d37-b937-4cbe-b00f-0bc6cd165c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:15.503769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5cbf4d37-b937-4cbe-b00f-0bc6cd165c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:15.510625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cbf4d37-b937-4cbe-b00f-0bc6cd165c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:15.511072 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cbf4d37-b937-4cbe-b00f-0bc6cd165c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:15.511829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cbf4d37-b937-4cbe-b00f-0bc6cd165c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:15.512259 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cbf4d37-b937-4cbe-b00f-0bc6cd165c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:15.539317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:15.539930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:15.540846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5cbf4d37-b937-4cbe-b00f-0bc6cd165c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041898 Apr 07 17:26:15.541447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 326/664] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:15.546177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:15.546624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:15.547395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:15.547833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:15.608808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:15.616687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-91ee2742-14d0-46b1-abed-252007c18f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081229 Apr 07 17:26:15.617277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 339/665] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:15 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:26:16.553028 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5cd5ae18-dddd-400a-9b62-b759b2026ed1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:16.554035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5cd5ae18-dddd-400a-9b62-b759b2026ed1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:16.560271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd5ae18-dddd-400a-9b62-b759b2026ed1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:16.560723 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd5ae18-dddd-400a-9b62-b759b2026ed1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:16.561520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd5ae18-dddd-400a-9b62-b759b2026ed1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:16.561959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cd5ae18-dddd-400a-9b62-b759b2026ed1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:16.589777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5cd5ae18-dddd-400a-9b62-b759b2026ed1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041352 Apr 07 17:26:16.590324 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 327/666] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:16.633225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:16.633843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:16.640112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:16.640560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:16.641358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:16.641795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:16.701119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:16.708485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-819fc5dd-3003-4dfb-a852-cbd8b4768bd7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079169 Apr 07 17:26:16.709051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 340/667] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:17.602372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bf5530db-cf5d-46f6-a26f-eef264229105 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:17.603312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bf5530db-cf5d-46f6-a26f-eef264229105 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:17.609174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf5530db-cf5d-46f6-a26f-eef264229105 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:17.609625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf5530db-cf5d-46f6-a26f-eef264229105 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:17.610379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf5530db-cf5d-46f6-a26f-eef264229105 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:17.610813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf5530db-cf5d-46f6-a26f-eef264229105 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:17.638152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bf5530db-cf5d-46f6-a26f-eef264229105 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040796 Apr 07 17:26:17.638722 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 328/668] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:17.725776 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:17.726388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:17.732606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:17.733053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:17.733843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:17.734278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:17.792304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:17.799454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4ebd8c4e-94f7-4b6f-a505-d76e6366b945 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078183 Apr 07 17:26:17.800008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 341/669] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:18.650760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4fc9a952-7465-42b9-9be1-babb020d39cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:18.651795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4fc9a952-7465-42b9-9be1-babb020d39cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:18.658085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fc9a952-7465-42b9-9be1-babb020d39cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:18.658528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fc9a952-7465-42b9-9be1-babb020d39cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:18.659285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fc9a952-7465-42b9-9be1-babb020d39cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:18.659719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fc9a952-7465-42b9-9be1-babb020d39cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:18.688761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4fc9a952-7465-42b9-9be1-babb020d39cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042266 Apr 07 17:26:18.689332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 329/670] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:26:18.816154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:18.817496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:18.823690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:18.824136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:18.824896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:18.825363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:18.883919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:18.891198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-93320e02-eaea-4b1d-acb1-1108407fe1c0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078969 Apr 07 17:26:18.891762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 342/671] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:18 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:19.700469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b24859ec-546e-4bc6-8186-45e5d8841f0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:19.701426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b24859ec-546e-4bc6-8186-45e5d8841f0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:19.707730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b24859ec-546e-4bc6-8186-45e5d8841f0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:19.708187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b24859ec-546e-4bc6-8186-45e5d8841f0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:19.708951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b24859ec-546e-4bc6-8186-45e5d8841f0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:19.709417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b24859ec-546e-4bc6-8186-45e5d8841f0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:19.743943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b24859ec-546e-4bc6-8186-45e5d8841f0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047398 Apr 07 17:26:19.744507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 330/672] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:19.908850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:19.909428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:19.916332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:19.916771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:19.917554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:19.917984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:19.977671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:19.984929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-43b465ab-4d05-406b-b3cd-1870a43f0527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080006 Apr 07 17:26:19.985535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 343/673] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:20.755525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9186c778-96d5-4ecf-8ac4-55d7d4241a07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:20.756434 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9186c778-96d5-4ecf-8ac4-55d7d4241a07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:20.762725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9186c778-96d5-4ecf-8ac4-55d7d4241a07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:20.763171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9186c778-96d5-4ecf-8ac4-55d7d4241a07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:20.763943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9186c778-96d5-4ecf-8ac4-55d7d4241a07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:20.764373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9186c778-96d5-4ecf-8ac4-55d7d4241a07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:20.793224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9186c778-96d5-4ecf-8ac4-55d7d4241a07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041599 Apr 07 17:26:20.793783 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 331/674] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:21.002168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:21.002784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:21.009842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:21.010294 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:21.011051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:21.011487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:21.069587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:21.076815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5e16c19f-5343-49ab-b5eb-6547dd47defc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078540 Apr 07 17:26:21.077421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 344/675] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:21.805336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fa9a1298-68b7-4914-a986-1a3a45b5ff00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:21.806278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fa9a1298-68b7-4914-a986-1a3a45b5ff00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:21.812458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa9a1298-68b7-4914-a986-1a3a45b5ff00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:21.812910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa9a1298-68b7-4914-a986-1a3a45b5ff00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:21.813703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa9a1298-68b7-4914-a986-1a3a45b5ff00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:21.814138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa9a1298-68b7-4914-a986-1a3a45b5ff00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:21.842754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fa9a1298-68b7-4914-a986-1a3a45b5ff00 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Apr 07 17:26:21.843297 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 332/676] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:22.093922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:22.094525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:22.101654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:22.102106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:22.102874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:22.103311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:22.164375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:22.171848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e33adcb1-3327-475c-aec5-26dd62fb08a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081775 Apr 07 17:26:22.172408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 345/677] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:22.854634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-51e377e0-310f-4031-9ae6-0ac81865fb5d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:22.855548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-51e377e0-310f-4031-9ae6-0ac81865fb5d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:22.862021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51e377e0-310f-4031-9ae6-0ac81865fb5d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:22.862472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51e377e0-310f-4031-9ae6-0ac81865fb5d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:22.863225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51e377e0-310f-4031-9ae6-0ac81865fb5d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:22.863655 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51e377e0-310f-4031-9ae6-0ac81865fb5d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:22.892070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-51e377e0-310f-4031-9ae6-0ac81865fb5d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041321 Apr 07 17:26:22.900196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 333/678] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:23.188598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:23.189238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:23.196394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:23.196837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:23.197625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:23.198057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:23.256377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:23.263775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f32f3454-f653-4c8c-ba68-12e7e8a627b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079064 Apr 07 17:26:23.264329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 346/679] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:23.909918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-717a75c1-5ba5-4da5-9861-40972dd48cd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:23.910794 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-717a75c1-5ba5-4da5-9861-40972dd48cd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:23.917841 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-717a75c1-5ba5-4da5-9861-40972dd48cd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:23.918286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-717a75c1-5ba5-4da5-9861-40972dd48cd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:23.919046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-717a75c1-5ba5-4da5-9861-40972dd48cd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:23.919487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-717a75c1-5ba5-4da5-9861-40972dd48cd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:23.947787 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-717a75c1-5ba5-4da5-9861-40972dd48cd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 Apr 07 17:26:23.948331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 334/680] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:24.280493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:24.281102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:24.287605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:24.288054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:24.288820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:24.289297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:24.346698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:24.353869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-17709296-8348-43e9-91c0-021738b06d50 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077192 Apr 07 17:26:24.354427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 347/681] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:24.959405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7a57519f-9de1-4c72-8caf-8c2b9f369b14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:24.960446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7a57519f-9de1-4c72-8caf-8c2b9f369b14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:24.966874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a57519f-9de1-4c72-8caf-8c2b9f369b14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:24.967321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a57519f-9de1-4c72-8caf-8c2b9f369b14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:24.968081 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a57519f-9de1-4c72-8caf-8c2b9f369b14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:24.968514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a57519f-9de1-4c72-8caf-8c2b9f369b14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:24.997258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7a57519f-9de1-4c72-8caf-8c2b9f369b14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041854 Apr 07 17:26:24.997808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 335/682] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:25.370679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:25.371245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:25.377926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:25.378373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:25.379143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:25.379580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:25.440149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:25.448079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cf4dcd8c-5e0a-407c-8920-38f1922db9f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081309 Apr 07 17:26:25.448637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 348/683] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:26.009970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7bd69dac-fb34-4974-9680-82ebef0644c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:26.010890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7bd69dac-fb34-4974-9680-82ebef0644c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:26.017092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bd69dac-fb34-4974-9680-82ebef0644c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:26.017575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bd69dac-fb34-4974-9680-82ebef0644c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:26.018367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bd69dac-fb34-4974-9680-82ebef0644c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:26.018802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bd69dac-fb34-4974-9680-82ebef0644c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:26.046298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7bd69dac-fb34-4974-9680-82ebef0644c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041089 Apr 07 17:26:26.046846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 336/684] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:26.464424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:26.465058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:26.471358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:26.471808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:26.472570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:26.473008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:26.530897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:26.538636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5d8690a6-977d-48f0-8d75-bc2d4f0c2c18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078065 Apr 07 17:26:26.539201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 349/685] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:27.058021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-85e8f079-b100-45db-ae4c-713a30506986 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:27.058944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-85e8f079-b100-45db-ae4c-713a30506986 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:27.065461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e8f079-b100-45db-ae4c-713a30506986 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:27.065911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e8f079-b100-45db-ae4c-713a30506986 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:27.066727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e8f079-b100-45db-ae4c-713a30506986 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:27.067147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-85e8f079-b100-45db-ae4c-713a30506986 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:27.095537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-85e8f079-b100-45db-ae4c-713a30506986 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041450 Apr 07 17:26:27.096084 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 337/686] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:27.555731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:27.556346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:27.562670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:27.563118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:27.563876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:27.564338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:27.623478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:27.631591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ff23b222-4a23-444b-af2a-e245c1b7e692 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080269 Apr 07 17:26:27.632149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 350/687] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:27 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:28.107040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b26d1a44-e109-4660-9f86-62bf7c19cb98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:28.107953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b26d1a44-e109-4660-9f86-62bf7c19cb98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:28.114334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b26d1a44-e109-4660-9f86-62bf7c19cb98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:28.114853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b26d1a44-e109-4660-9f86-62bf7c19cb98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:28.115606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b26d1a44-e109-4660-9f86-62bf7c19cb98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:28.116032 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b26d1a44-e109-4660-9f86-62bf7c19cb98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:28.143449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b26d1a44-e109-4660-9f86-62bf7c19cb98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040353 Apr 07 17:26:28.143972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 338/688] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:28.648206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:28.649080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:28.655417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:28.655860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:28.656623 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:28.657058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:28.719606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:28.727764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6ee2d6f2-316c-4947-b66a-7ff6ffe5ed62 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083603 Apr 07 17:26:28.728332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 351/689] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:29.155520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-42aaf145-8df4-4a33-8414-80d5d7e74e5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:29.156426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-42aaf145-8df4-4a33-8414-80d5d7e74e5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:29.163789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42aaf145-8df4-4a33-8414-80d5d7e74e5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:29.164230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42aaf145-8df4-4a33-8414-80d5d7e74e5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:29.164985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42aaf145-8df4-4a33-8414-80d5d7e74e5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:29.165507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42aaf145-8df4-4a33-8414-80d5d7e74e5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:29.193810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-42aaf145-8df4-4a33-8414-80d5d7e74e5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041765 Apr 07 17:26:29.194355 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 339/690] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:26:29.744847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:29.745486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:29.751793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:29.752245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:29.753012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:29.753482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:29.811952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:29.820270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9c8dd246-bba4-4fbb-a40b-c69660ca07e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079252 Apr 07 17:26:29.820825 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 352/691] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:29 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:30.205392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cfa97e07-a49c-447f-8d5a-20f226a088ff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:30.206324 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cfa97e07-a49c-447f-8d5a-20f226a088ff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:30.212679 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfa97e07-a49c-447f-8d5a-20f226a088ff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:30.213119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfa97e07-a49c-447f-8d5a-20f226a088ff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:30.213892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfa97e07-a49c-447f-8d5a-20f226a088ff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:30.214320 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfa97e07-a49c-447f-8d5a-20f226a088ff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:30.242878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cfa97e07-a49c-447f-8d5a-20f226a088ff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041437 Apr 07 17:26:30.243414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 340/692] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:30.837985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:30.838596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:30.844568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:30.849654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:30.849654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:30.849654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:30.907192 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:30.914569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-302a1e09-469a-4e20-b775-b643a4ca5f8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081821 Apr 07 17:26:30.915135 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 353/693] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:31.253935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6de66481-63c9-4161-8fdb-7900b4cd23b4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:31.255479 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6de66481-63c9-4161-8fdb-7900b4cd23b4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:31.261871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6de66481-63c9-4161-8fdb-7900b4cd23b4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:31.262408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6de66481-63c9-4161-8fdb-7900b4cd23b4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:31.263146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6de66481-63c9-4161-8fdb-7900b4cd23b4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:31.263580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6de66481-63c9-4161-8fdb-7900b4cd23b4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:31.291537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6de66481-63c9-4161-8fdb-7900b4cd23b4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041526 Apr 07 17:26:31.292084 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 341/694] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:31.931528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:31.934807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:31.938041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:31.938483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:31.939235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:31.939661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:31.998358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:32.005507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-825e5ebd-e390-48c6-bf1e-158f975145cc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077901 Apr 07 17:26:32.006064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 354/695] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:32.303985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f19f6041-a0a0-4aca-a2fd-128eb19bdfd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:32.304887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f19f6041-a0a0-4aca-a2fd-128eb19bdfd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:32.311088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f19f6041-a0a0-4aca-a2fd-128eb19bdfd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:32.311530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f19f6041-a0a0-4aca-a2fd-128eb19bdfd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:32.312278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f19f6041-a0a0-4aca-a2fd-128eb19bdfd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:32.312716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f19f6041-a0a0-4aca-a2fd-128eb19bdfd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:32.339680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f19f6041-a0a0-4aca-a2fd-128eb19bdfd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040511 Apr 07 17:26:32.340215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 342/696] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:33.022859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:33.023463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:33.029928 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:33.030369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:33.031124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:33.031554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:33.090141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:33.097534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3aa3938b-c97b-4689-87d2-932101586d59 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080242 Apr 07 17:26:33.098094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 355/697] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:33.351689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c6dc48f-5b6c-4c42-8c61-420016c7b457 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:33.352557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5c6dc48f-5b6c-4c42-8c61-420016c7b457 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:33.358766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6dc48f-5b6c-4c42-8c61-420016c7b457 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:33.359208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6dc48f-5b6c-4c42-8c61-420016c7b457 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:33.359958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6dc48f-5b6c-4c42-8c61-420016c7b457 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:33.360385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c6dc48f-5b6c-4c42-8c61-420016c7b457 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:33.389395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5c6dc48f-5b6c-4c42-8c61-420016c7b457 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042138 Apr 07 17:26:33.389949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 343/698] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:34.113910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:34.115159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:34.121445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:34.121891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:34.122651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:34.123086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:34.181034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:34.188218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dbaf9c1a-70bb-4e0d-a2d6-faf62b0bd72f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078197 Apr 07 17:26:34.188778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 356/699] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:34 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:34.400803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7ea8c4dd-8a38-4ce3-99f8-d2c1b4e515ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:34.401818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7ea8c4dd-8a38-4ce3-99f8-d2c1b4e515ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:34.407669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ea8c4dd-8a38-4ce3-99f8-d2c1b4e515ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:34.408191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ea8c4dd-8a38-4ce3-99f8-d2c1b4e515ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:34.408888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ea8c4dd-8a38-4ce3-99f8-d2c1b4e515ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:34.409361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ea8c4dd-8a38-4ce3-99f8-d2c1b4e515ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:34.437920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7ea8c4dd-8a38-4ce3-99f8-d2c1b4e515ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041417 Apr 07 17:26:34.438476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 344/700] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:35.205784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:35.206401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:35.213373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:35.213858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:35.214628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:35.215071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:35.277111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:35.284426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-33766d12-da56-438c-8027-7e6a94428c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082492 Apr 07 17:26:35.284989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 357/701] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:35.449601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3649c0d7-014a-4711-9ba7-eaf92bb3cd41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:35.450514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3649c0d7-014a-4711-9ba7-eaf92bb3cd41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:35.457051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3649c0d7-014a-4711-9ba7-eaf92bb3cd41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:35.457468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3649c0d7-014a-4711-9ba7-eaf92bb3cd41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:35.458918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3649c0d7-014a-4711-9ba7-eaf92bb3cd41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:35.459347 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3649c0d7-014a-4711-9ba7-eaf92bb3cd41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:35.488586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3649c0d7-014a-4711-9ba7-eaf92bb3cd41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042905 Apr 07 17:26:35.489239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 345/702] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:36.301355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:36.302044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:36.308824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:36.309311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:36.310087 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:36.310526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:36.368698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:36.376800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-71de3c1c-a683-4bc2-9b9e-c4ee638fb869 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079269 Apr 07 17:26:36.377404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 358/703] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:36.500185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e0ee555a-d588-4650-b456-170af4649de5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:36.501127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e0ee555a-d588-4650-b456-170af4649de5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:36.507499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0ee555a-d588-4650-b456-170af4649de5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:36.507943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0ee555a-d588-4650-b456-170af4649de5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:36.508695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0ee555a-d588-4650-b456-170af4649de5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:36.509126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0ee555a-d588-4650-b456-170af4649de5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:36.537577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e0ee555a-d588-4650-b456-170af4649de5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Apr 07 17:26:36.538114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 346/704] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:37.393618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:37.394249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:37.400837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:37.401321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:37.402086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:37.402524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:37.461498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:37.468805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6bcfe371-b8a1-4a17-9e18-3eeccd3bedf5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079135 Apr 07 17:26:37.469409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 359/705] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:37.549062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d1782bf7-1110-4eb4-8607-22ea0d04ecb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:37.550003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d1782bf7-1110-4eb4-8607-22ea0d04ecb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:37.556843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1782bf7-1110-4eb4-8607-22ea0d04ecb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:37.557330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1782bf7-1110-4eb4-8607-22ea0d04ecb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:37.558090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1782bf7-1110-4eb4-8607-22ea0d04ecb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:37.558526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1782bf7-1110-4eb4-8607-22ea0d04ecb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:37.585907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d1782bf7-1110-4eb4-8607-22ea0d04ecb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040747 Apr 07 17:26:37.586460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 347/706] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:38.485926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:38.486479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:38.492745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:38.493255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:38.494024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:38.494461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:38.553478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:38.560704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f766dfaa-f704-46f6-9713-51b9fa8e1701 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078716 Apr 07 17:26:38.561291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 360/707] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:38.597295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f6f5c8dc-b9f2-40b0-b23d-ee5b9b7fe3b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:38.598202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f6f5c8dc-b9f2-40b0-b23d-ee5b9b7fe3b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:38.605044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6f5c8dc-b9f2-40b0-b23d-ee5b9b7fe3b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:38.605518 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6f5c8dc-b9f2-40b0-b23d-ee5b9b7fe3b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:38.606272 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6f5c8dc-b9f2-40b0-b23d-ee5b9b7fe3b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:38.606699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6f5c8dc-b9f2-40b0-b23d-ee5b9b7fe3b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:38.636074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f6f5c8dc-b9f2-40b0-b23d-ee5b9b7fe3b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042617 Apr 07 17:26:38.636618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 348/708] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:39.578440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:39.578974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:39.585451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:39.585900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:39.586665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:39.587105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:39.644869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:39.651599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a5202db2-2ca3-418c-9938-3b200186773d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:39.651599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a5202db2-2ca3-418c-9938-3b200186773d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:39.653422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f6ac43d0-ed56-4519-9b96-fcf27ba2c026 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078827 Apr 07 17:26:39.654322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 361/709] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:39.656520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5202db2-2ca3-418c-9938-3b200186773d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:39.656961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5202db2-2ca3-418c-9938-3b200186773d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:39.657781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5202db2-2ca3-418c-9938-3b200186773d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:39.658211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5202db2-2ca3-418c-9938-3b200186773d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:39.687889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a5202db2-2ca3-418c-9938-3b200186773d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Apr 07 17:26:39.688442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 349/710] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:40.685302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:40.685302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:40.685302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:40.685302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:40.686116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:40.686116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:40.699235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-995cfdda-7df0-4dd3-8195-4486e5307fb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:40.700151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-995cfdda-7df0-4dd3-8195-4486e5307fb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:40.706309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-995cfdda-7df0-4dd3-8195-4486e5307fb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:40.706756 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-995cfdda-7df0-4dd3-8195-4486e5307fb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:40.707810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-995cfdda-7df0-4dd3-8195-4486e5307fb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:40.707992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-995cfdda-7df0-4dd3-8195-4486e5307fb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:40.737051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-995cfdda-7df0-4dd3-8195-4486e5307fb6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041610 Apr 07 17:26:40.737683 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 350/711] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:26:40.739496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:40.747070 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6e084508-85c5-4963-91ab-5c159e7d59d3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080099 Apr 07 17:26:40.747626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 362/712] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:41.748949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-03557331-5dac-4eec-ac46-62f30c4bc6e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:41.749897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-03557331-5dac-4eec-ac46-62f30c4bc6e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:41.756827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03557331-5dac-4eec-ac46-62f30c4bc6e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:41.758475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03557331-5dac-4eec-ac46-62f30c4bc6e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:41.758475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03557331-5dac-4eec-ac46-62f30c4bc6e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:41.758475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03557331-5dac-4eec-ac46-62f30c4bc6e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:41.763441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:41.764083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:41.770531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:41.770981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:41.771742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:41.772194 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:41.787230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-03557331-5dac-4eec-ac46-62f30c4bc6e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042150 Apr 07 17:26:41.787788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 351/713] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:41.835482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:41.842646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5ab7c85d-2ee2-4e92-a010-889e6a94b438 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082955 Apr 07 17:26:41.843205 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 363/714] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:42.798785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9cc7717a-590c-4170-b732-77fbb375cc13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:42.799703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9cc7717a-590c-4170-b732-77fbb375cc13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:42.806915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc7717a-590c-4170-b732-77fbb375cc13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:42.807359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc7717a-590c-4170-b732-77fbb375cc13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:42.808115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc7717a-590c-4170-b732-77fbb375cc13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:42.808548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc7717a-590c-4170-b732-77fbb375cc13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:42.836152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9cc7717a-590c-4170-b732-77fbb375cc13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041303 Apr 07 17:26:42.836703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 352/715] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:42.859474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:42.860086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:42.866996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:42.867449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:42.868214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:42.868651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:43.078781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:43.086684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8c28497e-cf2f-4635-927f-99f0b35c3833 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.231041 Apr 07 17:26:43.087256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 364/716] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:42 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:43.847089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fc736dcc-c359-410c-84be-73b590298272 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:43.848005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fc736dcc-c359-410c-84be-73b590298272 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:43.854667 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc736dcc-c359-410c-84be-73b590298272 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:43.855116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc736dcc-c359-410c-84be-73b590298272 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:43.855881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc736dcc-c359-410c-84be-73b590298272 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:43.856314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc736dcc-c359-410c-84be-73b590298272 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:43.885157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fc736dcc-c359-410c-84be-73b590298272 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042010 Apr 07 17:26:43.885720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 353/717] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:44.102568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:44.103212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:44.109475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:44.109924 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:44.110684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:44.111122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:44.169664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:44.177988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8c7da1d7-6221-45eb-ae08-82f98799c76a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079229 Apr 07 17:26:44.178536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 365/718] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:44 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:44.897055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7a397dbf-2717-4e93-ab7f-f50c8c983449 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:44.898827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7a397dbf-2717-4e93-ab7f-f50c8c983449 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:44.904697 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a397dbf-2717-4e93-ab7f-f50c8c983449 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:44.905091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a397dbf-2717-4e93-ab7f-f50c8c983449 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:44.905894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a397dbf-2717-4e93-ab7f-f50c8c983449 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:44.906331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a397dbf-2717-4e93-ab7f-f50c8c983449 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:44.935449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7a397dbf-2717-4e93-ab7f-f50c8c983449 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 Apr 07 17:26:44.936007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 354/719] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:45.195167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:45.195785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:45.202051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:45.202503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:45.203274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:45.203712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:45.261862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:45.269169 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9144f9c8-b2db-4958-9ca9-92e2b00a8765 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078399 Apr 07 17:26:45.269726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 366/720] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:45.947166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d9bb5e06-5c79-4bfe-8185-cd388d2bf70a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:45.948084 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d9bb5e06-5c79-4bfe-8185-cd388d2bf70a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:45.954318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9bb5e06-5c79-4bfe-8185-cd388d2bf70a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:45.954761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9bb5e06-5c79-4bfe-8185-cd388d2bf70a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:45.955525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9bb5e06-5c79-4bfe-8185-cd388d2bf70a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:45.955958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9bb5e06-5c79-4bfe-8185-cd388d2bf70a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:45.984343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d9bb5e06-5c79-4bfe-8185-cd388d2bf70a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041262 Apr 07 17:26:45.984879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 355/721] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:46.286983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:46.287559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:46.293894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:46.294353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:46.295126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:46.295566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:46.353702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:46.360957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-90d13829-b14d-4e40-87c1-9a01d48b08ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078612 Apr 07 17:26:46.361547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 367/722] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:46 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:26:46.995904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a1f54e02-aa07-4793-a1fe-350ac30ef6cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:46.996825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a1f54e02-aa07-4793-a1fe-350ac30ef6cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:47.003118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1f54e02-aa07-4793-a1fe-350ac30ef6cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:47.003567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1f54e02-aa07-4793-a1fe-350ac30ef6cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:47.004943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1f54e02-aa07-4793-a1fe-350ac30ef6cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:47.005410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1f54e02-aa07-4793-a1fe-350ac30ef6cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:47.033214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a1f54e02-aa07-4793-a1fe-350ac30ef6cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041232 Apr 07 17:26:47.033768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 356/723] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:47.377722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:47.378252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:47.384614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:47.385056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:47.385846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:47.386274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:47.444530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:47.451845 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3b57a4d1-2951-4c65-9d54-e2bc679d7cfe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078132 Apr 07 17:26:47.452414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 368/724] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:48.044379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f1b34ebf-3e23-4ed3-9ac6-4b985a412562 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:48.045340 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f1b34ebf-3e23-4ed3-9ac6-4b985a412562 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:48.051615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1b34ebf-3e23-4ed3-9ac6-4b985a412562 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:48.052062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1b34ebf-3e23-4ed3-9ac6-4b985a412562 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:48.052822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1b34ebf-3e23-4ed3-9ac6-4b985a412562 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:48.053286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1b34ebf-3e23-4ed3-9ac6-4b985a412562 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:48.080872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f1b34ebf-3e23-4ed3-9ac6-4b985a412562 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040415 Apr 07 17:26:48.081454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 357/725] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:48.468932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:48.469568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:48.476047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:48.476492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:48.477287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:48.477728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:48.539343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:48.546557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2a5e155c-504f-4c4a-a456-2461911a2cdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082550 Apr 07 17:26:48.547110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 369/726] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:49.092571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c4a00df7-c025-440c-adfa-cdc6b24bb23a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:49.093452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c4a00df7-c025-440c-adfa-cdc6b24bb23a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:49.100458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4a00df7-c025-440c-adfa-cdc6b24bb23a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:49.100910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4a00df7-c025-440c-adfa-cdc6b24bb23a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:49.101719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4a00df7-c025-440c-adfa-cdc6b24bb23a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:49.102155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4a00df7-c025-440c-adfa-cdc6b24bb23a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:49.129675 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c4a00df7-c025-440c-adfa-cdc6b24bb23a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040904 Apr 07 17:26:49.130132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 358/727] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:49.563801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:49.564394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:49.571283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:49.571732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:49.572494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:49.572931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:49.632808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:49.640128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a9617ac0-af90-4ae6-8253-f990c06d3875 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080171 Apr 07 17:26:49.640685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 370/728] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:50.141160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2a2c8072-c875-4084-901e-6cff99c9d07c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:50.142000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2a2c8072-c875-4084-901e-6cff99c9d07c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:50.148310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a2c8072-c875-4084-901e-6cff99c9d07c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:50.149018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a2c8072-c875-4084-901e-6cff99c9d07c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:50.149802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a2c8072-c875-4084-901e-6cff99c9d07c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:50.150237 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a2c8072-c875-4084-901e-6cff99c9d07c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:50.178765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2a2c8072-c875-4084-901e-6cff99c9d07c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041614 Apr 07 17:26:50.179312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 359/729] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:50.657829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:50.658472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:50.665492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:50.665943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:50.666716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:50.667158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:50.727838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:50.735253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b031c6e6-27c0-41a1-9bf9-6440ba3438df tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081378 Apr 07 17:26:50.735808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 371/730] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:50 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:51.190334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f6a940ca-8c69-4538-a247-7695c9e521e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:51.191256 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f6a940ca-8c69-4538-a247-7695c9e521e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:51.198154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6a940ca-8c69-4538-a247-7695c9e521e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:51.198605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6a940ca-8c69-4538-a247-7695c9e521e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:51.199369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6a940ca-8c69-4538-a247-7695c9e521e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:51.199803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f6a940ca-8c69-4538-a247-7695c9e521e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:51.227540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f6a940ca-8c69-4538-a247-7695c9e521e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041141 Apr 07 17:26:51.228090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 360/731] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:51.752828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:51.753503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:51.760279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:51.760726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:51.761531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:51.761970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:51.822647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:51.829918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1dc39e63-5f61-4231-b01a-02d6e817eb3b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081238 Apr 07 17:26:51.830472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 372/732] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:51 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:52.238637 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f064a6fd-94ae-4e59-be4c-82f85b167bb5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:52.239581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f064a6fd-94ae-4e59-be4c-82f85b167bb5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:52.245820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f064a6fd-94ae-4e59-be4c-82f85b167bb5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:52.246267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f064a6fd-94ae-4e59-be4c-82f85b167bb5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:52.247033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f064a6fd-94ae-4e59-be4c-82f85b167bb5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:52.247468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f064a6fd-94ae-4e59-be4c-82f85b167bb5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:52.275530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f064a6fd-94ae-4e59-be4c-82f85b167bb5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041013 Apr 07 17:26:52.276075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 361/733] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:52.847111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:52.848428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:52.854767 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:52.855218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:52.856039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:52.856485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:52.915652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:52.922960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0ae31747-3662-422a-865f-cf11880da4d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079790 Apr 07 17:26:52.923525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 373/734] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:52 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:53.287549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f88def76-280e-4bdc-b99c-803c44f30f3c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:53.288485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f88def76-280e-4bdc-b99c-803c44f30f3c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:53.294696 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f88def76-280e-4bdc-b99c-803c44f30f3c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:53.295136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f88def76-280e-4bdc-b99c-803c44f30f3c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:53.295889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f88def76-280e-4bdc-b99c-803c44f30f3c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:53.296317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f88def76-280e-4bdc-b99c-803c44f30f3c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:53.325121 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f88def76-280e-4bdc-b99c-803c44f30f3c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041983 Apr 07 17:26:53.325689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 362/735] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:53.939235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:53.939847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:53.946131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:53.946582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:53.947343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:53.947779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:54.005623 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:54.012869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b6472a4a-1810-4d8b-89d1-694655f67d29 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077487 Apr 07 17:26:54.013471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 374/736] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:54.337358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9e26a51c-c317-4b4b-9ff3-777f6f73fa7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:54.338192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9e26a51c-c317-4b4b-9ff3-777f6f73fa7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:54.344453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e26a51c-c317-4b4b-9ff3-777f6f73fa7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:54.344896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e26a51c-c317-4b4b-9ff3-777f6f73fa7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:54.345676 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e26a51c-c317-4b4b-9ff3-777f6f73fa7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:54.346106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e26a51c-c317-4b4b-9ff3-777f6f73fa7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:54.373922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9e26a51c-c317-4b4b-9ff3-777f6f73fa7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040705 Apr 07 17:26:54.374450 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 363/737] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:55.029879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:55.030475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:55.037576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:55.038025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:55.038795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:55.039230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:55.102053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:55.109449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f6da2315-afca-4e19-a1a2-e4fa6c1330ae tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083444 Apr 07 17:26:55.110023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 375/738] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:55.385596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-72c7484b-df44-4eb2-8ec8-b713b1cb2a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:55.386441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-72c7484b-df44-4eb2-8ec8-b713b1cb2a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:55.392672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72c7484b-df44-4eb2-8ec8-b713b1cb2a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:55.393119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72c7484b-df44-4eb2-8ec8-b713b1cb2a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:55.393909 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72c7484b-df44-4eb2-8ec8-b713b1cb2a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:55.394349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72c7484b-df44-4eb2-8ec8-b713b1cb2a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:55.423054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-72c7484b-df44-4eb2-8ec8-b713b1cb2a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041587 Apr 07 17:26:55.423593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 364/739] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:26:56.125926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:56.126522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:56.133585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:56.134039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:56.134813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:56.135284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:56.194962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:56.202244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-691c9124-5319-4168-b4e2-9980c2ab14c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080177 Apr 07 17:26:56.202809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 376/740] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:56.434743 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e7cd69be-7378-4858-b0be-eaecaefb377b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:56.435665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e7cd69be-7378-4858-b0be-eaecaefb377b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:56.441911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7cd69be-7378-4858-b0be-eaecaefb377b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:56.442367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7cd69be-7378-4858-b0be-eaecaefb377b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:56.443134 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7cd69be-7378-4858-b0be-eaecaefb377b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:56.443566 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7cd69be-7378-4858-b0be-eaecaefb377b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:56.470823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e7cd69be-7378-4858-b0be-eaecaefb377b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040053 Apr 07 17:26:56.471364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 365/741] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:57.218907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:57.219528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:57.225824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:57.226279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:57.227043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:57.227481 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:57.286332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:57.293734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aa56fc9e-8a9c-4311-b343-ea4484d894d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078629 Apr 07 17:26:57.294289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 377/742] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:57 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:57.482363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5265cd49-70b9-4374-b98c-41c63ba3dbea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:57.483273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5265cd49-70b9-4374-b98c-41c63ba3dbea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:57.490112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5265cd49-70b9-4374-b98c-41c63ba3dbea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:57.490553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5265cd49-70b9-4374-b98c-41c63ba3dbea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:57.491302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5265cd49-70b9-4374-b98c-41c63ba3dbea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:57.491732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5265cd49-70b9-4374-b98c-41c63ba3dbea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:57.520315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5265cd49-70b9-4374-b98c-41c63ba3dbea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Apr 07 17:26:57.520871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 366/743] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:26:58.313398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:58.314078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:58.321045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:58.321530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:58.322308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:58.322748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:58.385789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:58.393272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b886eedd-188d-4634-97ab-7803be39be63 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084978 Apr 07 17:26:58.393840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 378/744] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:58.531887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-631e6b27-7ef9-4cf3-b565-1751485de6b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:58.532795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-631e6b27-7ef9-4cf3-b565-1751485de6b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:58.539334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631e6b27-7ef9-4cf3-b565-1751485de6b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:58.539782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631e6b27-7ef9-4cf3-b565-1751485de6b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:58.540538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631e6b27-7ef9-4cf3-b565-1751485de6b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:58.540972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631e6b27-7ef9-4cf3-b565-1751485de6b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:58.569178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-631e6b27-7ef9-4cf3-b565-1751485de6b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041037 Apr 07 17:26:58.569654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 367/745] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:26:59.410900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:59.411504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:59.418180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:59.418627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:59.419385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:59.419815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:59.478360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:26:59.485525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ec61df00-4f2a-4f84-a0c5-b4fd347dfa8b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078479 Apr 07 17:26:59.486081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 379/746] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:26:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:26:59.580565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2503c99b-30f6-4f0a-9c70-7bdad4b38a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:26:59.581498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2503c99b-30f6-4f0a-9c70-7bdad4b38a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:26:59.588068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2503c99b-30f6-4f0a-9c70-7bdad4b38a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:59.588519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2503c99b-30f6-4f0a-9c70-7bdad4b38a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:59.589319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2503c99b-30f6-4f0a-9c70-7bdad4b38a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:26:59.589758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2503c99b-30f6-4f0a-9c70-7bdad4b38a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:26:59.620609 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2503c99b-30f6-4f0a-9c70-7bdad4b38a3f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Apr 07 17:26:59.621177 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 368/747] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:26:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:00.502298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:00.502903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:00.509707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:00.510150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:00.510905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:00.511335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:00.569778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:00.577081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2448cafd-6779-46c5-b88a-ecd3276c93c5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078598 Apr 07 17:27:00.577669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 380/748] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:00.632360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e892b16d-a4ab-42d4-9035-b439429af80a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:00.633334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e892b16d-a4ab-42d4-9035-b439429af80a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:00.639487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e892b16d-a4ab-42d4-9035-b439429af80a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:00.639929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e892b16d-a4ab-42d4-9035-b439429af80a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:00.640678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e892b16d-a4ab-42d4-9035-b439429af80a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:00.641106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e892b16d-a4ab-42d4-9035-b439429af80a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:00.670528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e892b16d-a4ab-42d4-9035-b439429af80a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042428 Apr 07 17:27:00.671073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 369/749] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:01.594354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:01.594960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:01.601574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:01.602029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:01.602792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:01.603232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:01.664192 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:01.671606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b4896e70-9bd7-4c9d-862e-851b7d31c740 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081116 Apr 07 17:27:01.672168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 381/750] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:01.681624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-57460436-bec4-4732-8586-fbe40e9ddcfe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:01.682547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-57460436-bec4-4732-8586-fbe40e9ddcfe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:01.688817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57460436-bec4-4732-8586-fbe40e9ddcfe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:01.689309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57460436-bec4-4732-8586-fbe40e9ddcfe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:01.690076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57460436-bec4-4732-8586-fbe40e9ddcfe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:01.690549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57460436-bec4-4732-8586-fbe40e9ddcfe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:01.718797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-57460436-bec4-4732-8586-fbe40e9ddcfe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041030 Apr 07 17:27:01.719346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 370/751] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:02.688485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:02.689098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:02.695470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:02.695927 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:02.696695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:02.697153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:02.730234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-40971065-015d-4cd4-bcc4-b791a583e7ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:02.731182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-40971065-015d-4cd4-bcc4-b791a583e7ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:02.737524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40971065-015d-4cd4-bcc4-b791a583e7ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:02.738074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40971065-015d-4cd4-bcc4-b791a583e7ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:02.738835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40971065-015d-4cd4-bcc4-b791a583e7ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:02.739286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40971065-015d-4cd4-bcc4-b791a583e7ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:02.755537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:02.762907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7645c867-ce17-42ec-8ae4-1bae6332b7a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078293 Apr 07 17:27:02.763763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 382/752] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:02 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:02.767374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-40971065-015d-4cd4-bcc4-b791a583e7ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040998 Apr 07 17:27:02.767924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 371/753] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:27:03.779884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b5c875ce-83e9-4511-994d-584c095f2d24 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:03.780431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:03.780808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:03.780900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b5c875ce-83e9-4511-994d-584c095f2d24 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:03.787704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:03.788158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:03.788296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5c875ce-83e9-4511-994d-584c095f2d24 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:03.788697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5c875ce-83e9-4511-994d-584c095f2d24 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:03.788927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:03.789395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:03.789528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5c875ce-83e9-4511-994d-584c095f2d24 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:03.789911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5c875ce-83e9-4511-994d-584c095f2d24 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:03.819390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b5c875ce-83e9-4511-994d-584c095f2d24 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Apr 07 17:27:03.819938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 383/754] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:03.848173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:03.855462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-04f3fc6e-51b6-4e75-be12-11fc4c97951f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079056 Apr 07 17:27:03.856026 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 372/755] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:04.830259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ed3b05f8-dada-4daf-9ca7-5a668c7ac6c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:04.831105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ed3b05f8-dada-4daf-9ca7-5a668c7ac6c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:04.844331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed3b05f8-dada-4daf-9ca7-5a668c7ac6c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:04.844785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed3b05f8-dada-4daf-9ca7-5a668c7ac6c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:04.845590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed3b05f8-dada-4daf-9ca7-5a668c7ac6c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:04.846033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed3b05f8-dada-4daf-9ca7-5a668c7ac6c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:04.872653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:04.873361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:04.876786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ed3b05f8-dada-4daf-9ca7-5a668c7ac6c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050528 Apr 07 17:27:04.877458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 384/756] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:04.879853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:04.880230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:04.881001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:04.881468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:04.939429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:04.947313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-66db8118-7c6c-4fca-99f4-10679310c4e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078573 Apr 07 17:27:04.947870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 373/757] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:04 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:27:05.889671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a2f3070b-c582-42f7-afc5-2321e883420b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:05.890510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a2f3070b-c582-42f7-afc5-2321e883420b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:05.896873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2f3070b-c582-42f7-afc5-2321e883420b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:05.898935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2f3070b-c582-42f7-afc5-2321e883420b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:05.898935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2f3070b-c582-42f7-afc5-2321e883420b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:05.898935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2f3070b-c582-42f7-afc5-2321e883420b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:05.927467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a2f3070b-c582-42f7-afc5-2321e883420b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 Apr 07 17:27:05.928006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 385/758] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:05.963603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:05.964213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:05.970432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:05.970883 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:05.971641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:05.972082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:06.030735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:06.038684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-074f4d31-4b61-4e7d-aed4-f66b4eb96ff9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078836 Apr 07 17:27:06.039244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 374/759] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:05 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:06.938947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5171cb57-ebd6-46f9-abb2-3611d5bac0f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:06.939905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5171cb57-ebd6-46f9-abb2-3611d5bac0f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:06.946744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5171cb57-ebd6-46f9-abb2-3611d5bac0f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:06.947191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5171cb57-ebd6-46f9-abb2-3611d5bac0f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:06.947946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5171cb57-ebd6-46f9-abb2-3611d5bac0f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:06.948375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5171cb57-ebd6-46f9-abb2-3611d5bac0f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:06.976954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5171cb57-ebd6-46f9-abb2-3611d5bac0f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042053 Apr 07 17:27:06.977543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 386/760] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:07.055992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:07.056607 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:07.062865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:07.065740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:07.065740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:07.065740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:07.126698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:07.135662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9bded554-d608-44e3-82f6-01e739441e8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083467 Apr 07 17:27:07.136372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 375/761] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:07.988528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-721af711-202b-4be1-85d0-035df0d4f474 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:07.989525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-721af711-202b-4be1-85d0-035df0d4f474 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:07.995872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-721af711-202b-4be1-85d0-035df0d4f474 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:07.996319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-721af711-202b-4be1-85d0-035df0d4f474 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:07.997107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-721af711-202b-4be1-85d0-035df0d4f474 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:07.997568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-721af711-202b-4be1-85d0-035df0d4f474 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:08.025743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-721af711-202b-4be1-85d0-035df0d4f474 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041755 Apr 07 17:27:08.026289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 387/762] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:08.151847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:08.152454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:08.158636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:08.159083 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:08.160392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:08.160832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:08.220720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:08.228600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f999f856-d896-4696-87e8-60ea013a1017 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080806 Apr 07 17:27:08.229194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 376/763] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:09.038028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e0bb5f12-1f39-4c03-ad34-011dae17f8d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:09.038946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e0bb5f12-1f39-4c03-ad34-011dae17f8d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:09.045421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0bb5f12-1f39-4c03-ad34-011dae17f8d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:09.046790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0bb5f12-1f39-4c03-ad34-011dae17f8d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:09.046790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0bb5f12-1f39-4c03-ad34-011dae17f8d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:09.047227 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0bb5f12-1f39-4c03-ad34-011dae17f8d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:09.076418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e0bb5f12-1f39-4c03-ad34-011dae17f8d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 Apr 07 17:27:09.080327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 388/764] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:09.245274 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:09.245876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:09.252122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:09.252558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:09.253372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:09.254284 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:09.312528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:09.320249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4efaaa48-c48f-42b5-baa3-59998bf193dc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078855 Apr 07 17:27:09.320801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 377/765] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:09 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:10.087999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e35692ee-68b1-4ff5-aec6-6db07c192fd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:10.088963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e35692ee-68b1-4ff5-aec6-6db07c192fd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:10.095262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35692ee-68b1-4ff5-aec6-6db07c192fd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:10.095711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35692ee-68b1-4ff5-aec6-6db07c192fd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:10.096482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35692ee-68b1-4ff5-aec6-6db07c192fd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:10.096923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35692ee-68b1-4ff5-aec6-6db07c192fd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:10.124895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e35692ee-68b1-4ff5-aec6-6db07c192fd1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Apr 07 17:27:10.125483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 389/766] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:10.336684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:10.337319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:10.343589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:10.343978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:10.344735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:10.345200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:10.404239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:10.412054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-95fb25a0-3899-439b-92f9-771939ce9e13 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079185 Apr 07 17:27:10.412613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 378/767] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:11.136279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6770d126-85ae-456c-bc0a-c3f2faff099e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:11.137220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6770d126-85ae-456c-bc0a-c3f2faff099e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:11.143431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6770d126-85ae-456c-bc0a-c3f2faff099e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:11.143877 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6770d126-85ae-456c-bc0a-c3f2faff099e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:11.145164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6770d126-85ae-456c-bc0a-c3f2faff099e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:11.145604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6770d126-85ae-456c-bc0a-c3f2faff099e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:11.173882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6770d126-85ae-456c-bc0a-c3f2faff099e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041584 Apr 07 17:27:11.174415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 390/768] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:11.427848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:11.428447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:11.435447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:11.438048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:11.438048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:11.438048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:11.500215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:11.507715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-663dae3b-5ad1-4dee-bdec-61a94e540fb0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083695 Apr 07 17:27:11.508275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 379/769] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:12.187515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d2f22771-eab7-417c-a631-86183358a7f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:12.188467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d2f22771-eab7-417c-a631-86183358a7f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:12.195344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2f22771-eab7-417c-a631-86183358a7f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:12.195793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2f22771-eab7-417c-a631-86183358a7f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:12.196558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2f22771-eab7-417c-a631-86183358a7f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:12.196997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2f22771-eab7-417c-a631-86183358a7f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:12.225121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d2f22771-eab7-417c-a631-86183358a7f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041579 Apr 07 17:27:12.225700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 391/770] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:12.524660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:12.525215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:12.531431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:12.531880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:12.532642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:12.533077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:12.590504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:12.597782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-84778f98-83cb-42ef-bdc4-2e7ab2075338 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077290 Apr 07 17:27:12.598357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 380/771] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:27:13.236653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d9c74409-506c-4d11-9dfa-e16620850291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:13.238268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d9c74409-506c-4d11-9dfa-e16620850291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:13.244807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9c74409-506c-4d11-9dfa-e16620850291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:13.245283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9c74409-506c-4d11-9dfa-e16620850291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:13.246042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9c74409-506c-4d11-9dfa-e16620850291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:13.246473 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9c74409-506c-4d11-9dfa-e16620850291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:13.275498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d9c74409-506c-4d11-9dfa-e16620850291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042757 Apr 07 17:27:13.276031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 392/772] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:13.615711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:13.616303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:13.622537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:13.622978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:13.623734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:13.624162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:13.683757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:13.691187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-50ac2cfa-f5ef-4397-a757-d5269256328c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080659 Apr 07 17:27:13.691897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 381/773] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:14.287091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-30fa0a02-11a2-480b-8455-773a41430c99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:14.288063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-30fa0a02-11a2-480b-8455-773a41430c99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:14.294330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30fa0a02-11a2-480b-8455-773a41430c99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:14.294782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30fa0a02-11a2-480b-8455-773a41430c99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:14.295546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30fa0a02-11a2-480b-8455-773a41430c99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:14.295984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30fa0a02-11a2-480b-8455-773a41430c99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:14.323984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-30fa0a02-11a2-480b-8455-773a41430c99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040935 Apr 07 17:27:14.324528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 393/774] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:14.708399 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:14.709018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:14.718593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:14.719190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:14.720486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:14.721333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:14.788872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:14.796141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-edc06d4e-8908-458b-8c4f-f6e1fe1474ee tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.092233 Apr 07 17:27:14.796691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 382/775] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:15.336271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-eadab28e-c1bc-4bb2-9551-09e5af623f98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:15.337211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-eadab28e-c1bc-4bb2-9551-09e5af623f98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:15.343447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eadab28e-c1bc-4bb2-9551-09e5af623f98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:15.343894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eadab28e-c1bc-4bb2-9551-09e5af623f98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:15.344656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eadab28e-c1bc-4bb2-9551-09e5af623f98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:15.345097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eadab28e-c1bc-4bb2-9551-09e5af623f98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:15.372965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-eadab28e-c1bc-4bb2-9551-09e5af623f98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041414 Apr 07 17:27:15.373537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 394/776] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:15.813377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:15.813988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:15.820877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:15.821360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:15.822126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:15.822563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:15.883338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:15.890574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-22d76e82-c4ad-40d9-a837-1dfdc0298599 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081124 Apr 07 17:27:15.891127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 383/777] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:15 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:16.384527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-140fe66a-7253-4333-b3ee-564be9b51cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:16.385512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-140fe66a-7253-4333-b3ee-564be9b51cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:16.391806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-140fe66a-7253-4333-b3ee-564be9b51cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:16.392262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-140fe66a-7253-4333-b3ee-564be9b51cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:16.393040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-140fe66a-7253-4333-b3ee-564be9b51cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:16.393508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-140fe66a-7253-4333-b3ee-564be9b51cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:16.422441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-140fe66a-7253-4333-b3ee-564be9b51cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 Apr 07 17:27:16.422987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 395/778] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:16.909109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:16.909802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:16.916273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:16.916723 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:16.917528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:16.917967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:16.977166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:16.984536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-34f184f2-8bcb-4971-9d93-c4740058dca6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079488 Apr 07 17:27:16.985109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 384/779] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:17.434254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4b9b8658-b489-4520-ab26-3498749b9446 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:17.435225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4b9b8658-b489-4520-ab26-3498749b9446 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:17.441675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b9b8658-b489-4520-ab26-3498749b9446 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:17.442127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b9b8658-b489-4520-ab26-3498749b9446 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:17.442897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b9b8658-b489-4520-ab26-3498749b9446 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:17.443335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b9b8658-b489-4520-ab26-3498749b9446 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:17.471185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4b9b8658-b489-4520-ab26-3498749b9446 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041022 Apr 07 17:27:17.471741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 396/780] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:27:18.001709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:18.002314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:18.009439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:18.009884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:18.010638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:18.011067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:18.069748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:18.076948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cb60fb6f-c5b9-498e-8292-0323876980fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079145 Apr 07 17:27:18.077559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 385/781] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:18.483424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0fd418a0-362b-4a12-a568-c3a427498b04 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:18.484348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0fd418a0-362b-4a12-a568-c3a427498b04 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:18.491318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fd418a0-362b-4a12-a568-c3a427498b04 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:18.491772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fd418a0-362b-4a12-a568-c3a427498b04 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:18.492542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fd418a0-362b-4a12-a568-c3a427498b04 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:18.492981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0fd418a0-362b-4a12-a568-c3a427498b04 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:18.522965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0fd418a0-362b-4a12-a568-c3a427498b04 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Apr 07 17:27:18.523831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 397/782] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:19.094495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:19.095045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:19.102276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:19.107195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:19.107195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:19.107195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:19.164199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:19.171455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-84d7fb4c-0a41-4607-ae80-3417f50cfdcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080878 Apr 07 17:27:19.172027 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 386/783] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:27:19.534266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7dda4a03-0004-4e64-a182-40a24f0936c9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:19.535667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7dda4a03-0004-4e64-a182-40a24f0936c9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:19.541947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dda4a03-0004-4e64-a182-40a24f0936c9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:19.542388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dda4a03-0004-4e64-a182-40a24f0936c9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:19.543148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dda4a03-0004-4e64-a182-40a24f0936c9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:19.543577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dda4a03-0004-4e64-a182-40a24f0936c9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:19.572151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7dda4a03-0004-4e64-a182-40a24f0936c9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041888 Apr 07 17:27:19.572684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 398/784] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:20.188073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:20.188681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:20.194999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:20.195450 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:20.196217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:20.196650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:20.254743 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:20.261976 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-747497ee-bb35-457a-83ec-d39654cd4fc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077813 Apr 07 17:27:20.262536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 387/785] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:20.584350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e0f73e00-a841-4404-870e-a7dd8dd9c568 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:20.585209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e0f73e00-a841-4404-870e-a7dd8dd9c568 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:20.591479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0f73e00-a841-4404-870e-a7dd8dd9c568 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:20.591926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0f73e00-a841-4404-870e-a7dd8dd9c568 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:20.592684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0f73e00-a841-4404-870e-a7dd8dd9c568 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:20.593120 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0f73e00-a841-4404-870e-a7dd8dd9c568 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:20.621115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e0f73e00-a841-4404-870e-a7dd8dd9c568 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041451 Apr 07 17:27:20.621682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 399/786] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:21.278996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:21.279613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:21.286416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:21.286862 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:21.287621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:21.288055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:21.348508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:21.355807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-61f385c7-de32-4a29-8677-57b3abc615fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080669 Apr 07 17:27:21.356366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 388/787] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:21 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:21.632992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8b76af4b-6bf0-422e-9f12-9dee9d69fd73 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:21.633897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8b76af4b-6bf0-422e-9f12-9dee9d69fd73 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:21.640127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b76af4b-6bf0-422e-9f12-9dee9d69fd73 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:21.640574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b76af4b-6bf0-422e-9f12-9dee9d69fd73 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:21.641365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b76af4b-6bf0-422e-9f12-9dee9d69fd73 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:21.641796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b76af4b-6bf0-422e-9f12-9dee9d69fd73 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:21.672309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8b76af4b-6bf0-422e-9f12-9dee9d69fd73 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043758 Apr 07 17:27:21.673091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 400/788] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:22.373931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:22.374549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:22.381465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:22.381918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:22.382681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:22.383119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:22.442388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:22.449788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-272e5385-fbcb-424e-9153-6a62b717d5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079700 Apr 07 17:27:22.450352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 389/789] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:22.683972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-30f05e12-69df-4643-88d8-c79632ad005f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:22.684895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-30f05e12-69df-4643-88d8-c79632ad005f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:22.691478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30f05e12-69df-4643-88d8-c79632ad005f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:22.691929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30f05e12-69df-4643-88d8-c79632ad005f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:22.692729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30f05e12-69df-4643-88d8-c79632ad005f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:22.693195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30f05e12-69df-4643-88d8-c79632ad005f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:22.720894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-30f05e12-69df-4643-88d8-c79632ad005f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040843 Apr 07 17:27:22.721489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 401/790] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:23.466585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:23.467220 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:23.473670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:23.474113 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:23.474873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:23.475299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:23.535620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:23.542816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a5fcb4b5-b747-48a9-ad05-63f02d458789 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080074 Apr 07 17:27:23.543374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 390/791] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:23.733115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f29259ac-40ad-4bf6-8fd4-820586bd58e3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:23.733993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f29259ac-40ad-4bf6-8fd4-820586bd58e3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:23.740786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29259ac-40ad-4bf6-8fd4-820586bd58e3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:23.741268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29259ac-40ad-4bf6-8fd4-820586bd58e3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:23.742031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29259ac-40ad-4bf6-8fd4-820586bd58e3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:23.742467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29259ac-40ad-4bf6-8fd4-820586bd58e3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:23.770466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f29259ac-40ad-4bf6-8fd4-820586bd58e3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041479 Apr 07 17:27:23.771008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 402/792] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:24.560118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:24.560707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:24.567920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:24.568354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:24.569111 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:24.569563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:24.627707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:24.635904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-88d42b33-8c9f-410b-a3de-d20b5ee41fbc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079499 Apr 07 17:27:24.646186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 391/793] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:24.781631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bf461b36-cbf0-49f2-a95f-f7b42af34f7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:24.782552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bf461b36-cbf0-49f2-a95f-f7b42af34f7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:24.789582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf461b36-cbf0-49f2-a95f-f7b42af34f7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:24.790034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf461b36-cbf0-49f2-a95f-f7b42af34f7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:24.790798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf461b36-cbf0-49f2-a95f-f7b42af34f7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:24.791265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf461b36-cbf0-49f2-a95f-f7b42af34f7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:24.819558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bf461b36-cbf0-49f2-a95f-f7b42af34f7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041784 Apr 07 17:27:24.820034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 403/794] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:25.660834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:25.661469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:25.667788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:25.668241 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:25.669000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:25.669477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:25.729556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:25.736654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7ab54f65-d26e-457a-b515-d928bff95007 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080220 Apr 07 17:27:25.737807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 392/795] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:25.830215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e1d15dcf-de1c-46fa-9d95-0e062dfce60d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:25.831758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e1d15dcf-de1c-46fa-9d95-0e062dfce60d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:25.838053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1d15dcf-de1c-46fa-9d95-0e062dfce60d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:25.838502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1d15dcf-de1c-46fa-9d95-0e062dfce60d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:25.839271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1d15dcf-de1c-46fa-9d95-0e062dfce60d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:25.839708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1d15dcf-de1c-46fa-9d95-0e062dfce60d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:25.867780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e1d15dcf-de1c-46fa-9d95-0e062dfce60d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041531 Apr 07 17:27:25.868323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 404/796] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:26.754026 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:26.754638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:26.760993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:26.761480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:26.762239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:26.762673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:26.821044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:26.828402 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2ed83705-236c-45be-b920-79d091acefed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078307 Apr 07 17:27:26.828954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 393/797] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:26.879135 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a79207bf-76db-4fa1-907a-8fe020d33cdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:26.880046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a79207bf-76db-4fa1-907a-8fe020d33cdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:26.886419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a79207bf-76db-4fa1-907a-8fe020d33cdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:26.886867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a79207bf-76db-4fa1-907a-8fe020d33cdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:26.887625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a79207bf-76db-4fa1-907a-8fe020d33cdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:26.888061 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a79207bf-76db-4fa1-907a-8fe020d33cdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:26.917309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a79207bf-76db-4fa1-907a-8fe020d33cdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042286 Apr 07 17:27:26.917850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 405/798] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:27.845592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:27.846201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:27.852965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:27.853441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:27.854203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:27.854637 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:27.915636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:27.923089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-75b0f169-767b-4319-b5a3-b1ee63dfd6ed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081298 Apr 07 17:27:27.923650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 394/799] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:27 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:27.928641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-25a2f39f-69bf-4632-ae1f-0350524047de tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:27.929596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-25a2f39f-69bf-4632-ae1f-0350524047de tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:27.935861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-25a2f39f-69bf-4632-ae1f-0350524047de tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:27.936314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-25a2f39f-69bf-4632-ae1f-0350524047de tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:27.937083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-25a2f39f-69bf-4632-ae1f-0350524047de tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:27.937552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-25a2f39f-69bf-4632-ae1f-0350524047de tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:27.964964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-25a2f39f-69bf-4632-ae1f-0350524047de tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040893 Apr 07 17:27:27.965543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 406/800] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:27:28.939787 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:28.941029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:28.947364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:28.947810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:28.948567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:28.949003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:28.976558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8254cd9a-89c6-44d2-b252-9965d843604f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:28.978071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8254cd9a-89c6-44d2-b252-9965d843604f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:28.984637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8254cd9a-89c6-44d2-b252-9965d843604f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:28.985097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8254cd9a-89c6-44d2-b252-9965d843604f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:28.985913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8254cd9a-89c6-44d2-b252-9965d843604f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:28.986357 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8254cd9a-89c6-44d2-b252-9965d843604f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:29.008163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:29.016206 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4a368418-4d27-4ce3-b37a-e210fc1d0f6d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080161 Apr 07 17:27:29.020568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 395/801] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:29.020683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8254cd9a-89c6-44d2-b252-9965d843604f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Apr 07 17:27:29.020683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 407/802] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:27:30.029059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c2cee1cf-adab-4e45-b6a5-9646d4b66924 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:30.030014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c2cee1cf-adab-4e45-b6a5-9646d4b66924 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:30.033652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:30.034369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:30.036492 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2cee1cf-adab-4e45-b6a5-9646d4b66924 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:30.036946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2cee1cf-adab-4e45-b6a5-9646d4b66924 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:30.037746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2cee1cf-adab-4e45-b6a5-9646d4b66924 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:30.038177 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2cee1cf-adab-4e45-b6a5-9646d4b66924 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:30.040813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:30.041305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:30.042085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:30.042585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:30.066451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c2cee1cf-adab-4e45-b6a5-9646d4b66924 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041319 Apr 07 17:27:30.067252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 396/803] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:30.103359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:30.110799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-44b08dc1-58cd-4070-9e68-4591cda03b84 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081077 Apr 07 17:27:30.111404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 408/804] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:27:31.078238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-949dacb8-8e42-4db5-8942-099331fde44f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:31.079154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-949dacb8-8e42-4db5-8942-099331fde44f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:31.086228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949dacb8-8e42-4db5-8942-099331fde44f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:31.086670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949dacb8-8e42-4db5-8942-099331fde44f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:31.087422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949dacb8-8e42-4db5-8942-099331fde44f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:31.087847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949dacb8-8e42-4db5-8942-099331fde44f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:31.116145 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-949dacb8-8e42-4db5-8942-099331fde44f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041846 Apr 07 17:27:31.116689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 397/805] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:31.127352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:31.128002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:31.134257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:31.134711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:31.135482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:31.135926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:31.194907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:31.202195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-182cef87-4a95-4df9-9959-f7e57a4a8c5c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078692 Apr 07 17:27:31.202760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 409/806] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:32.128691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-825f07f2-7975-459f-a205-005fd47c3418 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:32.129646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-825f07f2-7975-459f-a205-005fd47c3418 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:32.135900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-825f07f2-7975-459f-a205-005fd47c3418 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:32.136352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-825f07f2-7975-459f-a205-005fd47c3418 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:32.137115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-825f07f2-7975-459f-a205-005fd47c3418 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:32.137645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-825f07f2-7975-459f-a205-005fd47c3418 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:32.165847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-825f07f2-7975-459f-a205-005fd47c3418 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041754 Apr 07 17:27:32.166395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 398/807] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:32.218614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:32.219220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:32.225650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:32.226098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:32.226851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:32.227285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:32.285573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:32.292839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e9fd1ebe-5fc8-4b03-b194-08972ff67ca3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078208 Apr 07 17:27:32.293438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 410/808] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:32 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:33.178146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1d553d6d-f2a7-4e14-a585-ac3aa4405a8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:33.179265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1d553d6d-f2a7-4e14-a585-ac3aa4405a8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:33.185646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d553d6d-f2a7-4e14-a585-ac3aa4405a8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:33.190732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d553d6d-f2a7-4e14-a585-ac3aa4405a8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:33.190732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d553d6d-f2a7-4e14-a585-ac3aa4405a8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:33.190732 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d553d6d-f2a7-4e14-a585-ac3aa4405a8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:33.217251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1d553d6d-f2a7-4e14-a585-ac3aa4405a8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Apr 07 17:27:33.217814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 399/809] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:33.309985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:33.310589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:33.316826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:33.317343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:33.323839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:33.323839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:33.376105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:33.383354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a88a314e-567e-4e95-8105-4d57f7ace723 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077222 Apr 07 17:27:33.383914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 411/810] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:34.228957 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a351a5dd-37e6-4365-b229-a33aeb8fad39 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:34.229900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a351a5dd-37e6-4365-b229-a33aeb8fad39 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:34.235838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a351a5dd-37e6-4365-b229-a33aeb8fad39 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:34.236287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a351a5dd-37e6-4365-b229-a33aeb8fad39 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:34.237794 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a351a5dd-37e6-4365-b229-a33aeb8fad39 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:34.238372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a351a5dd-37e6-4365-b229-a33aeb8fad39 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:34.266425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a351a5dd-37e6-4365-b229-a33aeb8fad39 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Apr 07 17:27:34.266965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 400/811] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:34.400348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:34.400964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:34.407546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:34.408013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:34.409482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:34.409968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:34.472479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:34.480083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-753d9c25-8e6d-4e23-bb73-12b09262c290 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083690 Apr 07 17:27:34.480596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 412/812] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:34 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:35.278402 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a4785581-1c7c-47b2-b8d0-7bdbfa0bab40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:35.279330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a4785581-1c7c-47b2-b8d0-7bdbfa0bab40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:35.286106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4785581-1c7c-47b2-b8d0-7bdbfa0bab40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:35.286545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4785581-1c7c-47b2-b8d0-7bdbfa0bab40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:35.287299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4785581-1c7c-47b2-b8d0-7bdbfa0bab40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:35.287735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4785581-1c7c-47b2-b8d0-7bdbfa0bab40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:35.315866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a4785581-1c7c-47b2-b8d0-7bdbfa0bab40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040658 Apr 07 17:27:35.316509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 401/813] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:27:35.496095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:35.496817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:35.506491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:35.506947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:35.507724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:35.508165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:35.567304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:35.575234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8073ad3d-5af7-4254-b3b8-3613a3e2b322 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082914 Apr 07 17:27:35.575809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 413/814] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:36.326952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-de42f59b-5cff-402f-83b0-444f54a5ba9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:36.327909 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-de42f59b-5cff-402f-83b0-444f54a5ba9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:36.334341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de42f59b-5cff-402f-83b0-444f54a5ba9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:36.334795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de42f59b-5cff-402f-83b0-444f54a5ba9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:36.335561 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de42f59b-5cff-402f-83b0-444f54a5ba9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:36.336002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de42f59b-5cff-402f-83b0-444f54a5ba9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:36.370901 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-de42f59b-5cff-402f-83b0-444f54a5ba9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047911 Apr 07 17:27:36.371465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 402/815] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:36.591775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:36.592301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:36.599342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:36.599787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:36.600544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:36.600975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:36.665738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:36.673110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-922f887f-4a7c-4d05-a842-112583dfef6c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085282 Apr 07 17:27:36.673700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 414/816] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:37.382731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1f625676-9a21-4524-9d89-70ec9034af10 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:37.383652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1f625676-9a21-4524-9d89-70ec9034af10 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:37.390576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f625676-9a21-4524-9d89-70ec9034af10 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:37.391030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f625676-9a21-4524-9d89-70ec9034af10 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:37.391784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f625676-9a21-4524-9d89-70ec9034af10 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:37.392218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f625676-9a21-4524-9d89-70ec9034af10 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:37.421792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1f625676-9a21-4524-9d89-70ec9034af10 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042967 Apr 07 17:27:37.422344 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 403/817] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:27:37.690491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:37.691097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:37.700810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:37.701285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:37.702072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:37.702506 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:37.760986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:37.768230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c6034833-9043-4c76-bcec-bc8b7b1897b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082178 Apr 07 17:27:37.768952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 415/818] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:38.433080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c8159e65-455e-4700-b067-d8affbc38f1f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:38.434012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c8159e65-455e-4700-b067-d8affbc38f1f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:38.440766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8159e65-455e-4700-b067-d8affbc38f1f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:38.441238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8159e65-455e-4700-b067-d8affbc38f1f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:38.442001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8159e65-455e-4700-b067-d8affbc38f1f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:38.442432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c8159e65-455e-4700-b067-d8affbc38f1f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:38.470589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c8159e65-455e-4700-b067-d8affbc38f1f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041386 Apr 07 17:27:38.473280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 404/819] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:38.786046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:38.786577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:38.792764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:38.793239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:38.793996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:38.794432 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:38.853047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:38.860304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-62d3a093-d028-448b-8a6e-180d41f9ba55 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078941 Apr 07 17:27:38.860889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 416/820] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:39.483140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b0776b47-2785-4d45-bb4c-da6b8e936be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:39.483971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b0776b47-2785-4d45-bb4c-da6b8e936be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:39.491028 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0776b47-2785-4d45-bb4c-da6b8e936be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:39.491465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0776b47-2785-4d45-bb4c-da6b8e936be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:39.492216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0776b47-2785-4d45-bb4c-da6b8e936be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:39.492642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0776b47-2785-4d45-bb4c-da6b8e936be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:39.521174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b0776b47-2785-4d45-bb4c-da6b8e936be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042041 Apr 07 17:27:39.521721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 405/821] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:39.877045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:39.877811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:39.884115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:39.884559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:39.885358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:39.885791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:39.945193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:39.952345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-70c72a10-8a01-4dad-b76c-0b60452a1828 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079248 Apr 07 17:27:39.952911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 417/822] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:40.532034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7a493ee8-7f43-4829-876d-77ba798b188a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:40.532974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7a493ee8-7f43-4829-876d-77ba798b188a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:40.539772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a493ee8-7f43-4829-876d-77ba798b188a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:40.540221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a493ee8-7f43-4829-876d-77ba798b188a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:40.540976 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a493ee8-7f43-4829-876d-77ba798b188a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:40.541446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a493ee8-7f43-4829-876d-77ba798b188a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:40.569124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7a493ee8-7f43-4829-876d-77ba798b188a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041009 Apr 07 17:27:40.569678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 406/823] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:40.969186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:40.969790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:40.976786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:40.977258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:40.978020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:40.978450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:41.040326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:41.047696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cb03b4fb-78a4-4936-b895-29ae4c98e206 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082392 Apr 07 17:27:41.048265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 418/824] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:41.581108 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-66d79741-356b-448d-a680-5c7537071766 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:41.582079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-66d79741-356b-448d-a680-5c7537071766 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:41.588287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66d79741-356b-448d-a680-5c7537071766 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:41.588731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66d79741-356b-448d-a680-5c7537071766 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:41.589509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66d79741-356b-448d-a680-5c7537071766 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:41.589944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66d79741-356b-448d-a680-5c7537071766 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:41.618007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-66d79741-356b-448d-a680-5c7537071766 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041440 Apr 07 17:27:41.618543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 407/825] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:42.064424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:42.065324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:42.071593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:42.072036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:42.072791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:42.073246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:42.131713 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:42.138986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f8c019a1-e4bd-46f9-9af9-bd5861ab6c72 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078405 Apr 07 17:27:42.139541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 419/826] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:42 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:42.629750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-79d8fe36-5f37-4604-9d74-2b32e1ab82b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:42.630664 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-79d8fe36-5f37-4604-9d74-2b32e1ab82b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:42.636964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79d8fe36-5f37-4604-9d74-2b32e1ab82b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:42.637438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79d8fe36-5f37-4604-9d74-2b32e1ab82b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:42.638195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79d8fe36-5f37-4604-9d74-2b32e1ab82b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:42.638622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-79d8fe36-5f37-4604-9d74-2b32e1ab82b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:42.668138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-79d8fe36-5f37-4604-9d74-2b32e1ab82b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 Apr 07 17:27:42.668692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 408/827] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:43.155937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:43.156570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:43.163027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:43.163471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:43.164224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:43.164658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:43.222720 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:43.229956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6aef75c1-209d-4454-b0ac-dd0c370ea7ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077892 Apr 07 17:27:43.230510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 420/828] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:43 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:43.680385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7d6f6b8c-e68f-48d8-9cad-fb3420e7624b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:43.681340 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7d6f6b8c-e68f-48d8-9cad-fb3420e7624b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:43.687539 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d6f6b8c-e68f-48d8-9cad-fb3420e7624b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:43.687989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d6f6b8c-e68f-48d8-9cad-fb3420e7624b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:43.688748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d6f6b8c-e68f-48d8-9cad-fb3420e7624b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:43.689213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d6f6b8c-e68f-48d8-9cad-fb3420e7624b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:43.718000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7d6f6b8c-e68f-48d8-9cad-fb3420e7624b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041595 Apr 07 17:27:43.718557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 409/829] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:44.246879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:44.247490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:44.254344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:44.254798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:44.255572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:44.256014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:44.316234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:44.323607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9bc4f8df-d00d-4447-8ea0-d4f47c03476f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080647 Apr 07 17:27:44.324171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 421/830] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:44 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:44.730039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-aec5effb-a885-400c-abd8-f74aa306e3f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:44.730947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-aec5effb-a885-400c-abd8-f74aa306e3f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:44.737259 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aec5effb-a885-400c-abd8-f74aa306e3f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:44.738259 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aec5effb-a885-400c-abd8-f74aa306e3f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:44.739024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aec5effb-a885-400c-abd8-f74aa306e3f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:44.739458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aec5effb-a885-400c-abd8-f74aa306e3f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:44.767378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-aec5effb-a885-400c-abd8-f74aa306e3f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041217 Apr 07 17:27:44.767922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 410/831] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:45.340827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:45.341384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:45.348465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:45.348912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:45.349699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:45.350137 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:45.408534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:45.416487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fd4f3265-812a-4841-8c12-b512e6b16e22 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079621 Apr 07 17:27:45.417046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 422/832] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:45.779169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-289f43ed-e686-4237-a7a2-108ba1855a21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:45.780093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-289f43ed-e686-4237-a7a2-108ba1855a21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:45.786395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-289f43ed-e686-4237-a7a2-108ba1855a21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:45.786841 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-289f43ed-e686-4237-a7a2-108ba1855a21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:45.787602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-289f43ed-e686-4237-a7a2-108ba1855a21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:45.788040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-289f43ed-e686-4237-a7a2-108ba1855a21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:45.815254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-289f43ed-e686-4237-a7a2-108ba1855a21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040081 Apr 07 17:27:45.816367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 411/833] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:46.433721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:46.434318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:46.440592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:46.441259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:46.442057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:46.442490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:46.500004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:46.507547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-39b1e06b-a5c6-4cf0-b6bf-b57fa5fd09ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077658 Apr 07 17:27:46.508114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 423/834] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:46 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:46.827512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2a86a844-81fa-4e42-9743-3160c577564d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:46.828394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2a86a844-81fa-4e42-9743-3160c577564d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:46.835354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a86a844-81fa-4e42-9743-3160c577564d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:46.835804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a86a844-81fa-4e42-9743-3160c577564d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:46.836570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a86a844-81fa-4e42-9743-3160c577564d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:46.837010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2a86a844-81fa-4e42-9743-3160c577564d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:46.865733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2a86a844-81fa-4e42-9743-3160c577564d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042241 Apr 07 17:27:46.866285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 412/835] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:47.570066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:47.570704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:47.576495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:47.576943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:47.577730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:47.578167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:47.639389 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:47.646938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-13872e1b-1881-4aa7-a133-c63c525e3fa5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.126516 Apr 07 17:27:47.647497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 424/836] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:27:47.877248 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a27011a9-4df2-4f88-9a96-277af02efcdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:47.878154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a27011a9-4df2-4f88-9a96-277af02efcdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:47.885100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a27011a9-4df2-4f88-9a96-277af02efcdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:47.885580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a27011a9-4df2-4f88-9a96-277af02efcdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:47.886350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a27011a9-4df2-4f88-9a96-277af02efcdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:47.886818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a27011a9-4df2-4f88-9a96-277af02efcdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:47.915155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a27011a9-4df2-4f88-9a96-277af02efcdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041885 Apr 07 17:27:47.915701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 413/837] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:48.666926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:48.667678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:48.674123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:48.674577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:48.675501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:48.675947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:48.735116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:48.742717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-debe0533-4bc3-48ba-b294-e1d5eea06a94 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079706 Apr 07 17:27:48.743285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 425/838] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:48.926233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e6cff640-384e-435d-bc2e-4e83ac3ec159 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:48.927146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e6cff640-384e-435d-bc2e-4e83ac3ec159 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:48.933420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6cff640-384e-435d-bc2e-4e83ac3ec159 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:48.933865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6cff640-384e-435d-bc2e-4e83ac3ec159 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:48.934629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6cff640-384e-435d-bc2e-4e83ac3ec159 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:48.935056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6cff640-384e-435d-bc2e-4e83ac3ec159 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:48.964091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e6cff640-384e-435d-bc2e-4e83ac3ec159 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 Apr 07 17:27:48.964638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 414/839] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:49.285424 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:27:49.285634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:27:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:27:49.760104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:49.760723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:49.767049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:49.767501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:49.768273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:49.769448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:49.827502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:49.835127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e0b4d04c-4099-4efe-a0ed-664ba881567b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078938 Apr 07 17:27:49.835702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 426/840] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:49.976054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-66211a56-2949-4d91-976e-731fb52f720a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:49.977038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-66211a56-2949-4d91-976e-731fb52f720a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:49.983500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66211a56-2949-4d91-976e-731fb52f720a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:49.983939 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66211a56-2949-4d91-976e-731fb52f720a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:49.984688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66211a56-2949-4d91-976e-731fb52f720a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:49.985118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66211a56-2949-4d91-976e-731fb52f720a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:50.017079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-66211a56-2949-4d91-976e-731fb52f720a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045426 Apr 07 17:27:50.017646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 415/841] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:50.852391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:50.853007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:50.859351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:50.859809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:50.860625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:50.861060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:50.921783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:50.929303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5ba567e4-d929-48c4-ac96-491ddef493c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080877 Apr 07 17:27:50.929865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 427/842] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:50 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:51.028421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7a5e5061-97d8-4331-a7ce-25a64fd0a90d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:51.029358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7a5e5061-97d8-4331-a7ce-25a64fd0a90d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:51.036040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a5e5061-97d8-4331-a7ce-25a64fd0a90d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:51.036484 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a5e5061-97d8-4331-a7ce-25a64fd0a90d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:51.037260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a5e5061-97d8-4331-a7ce-25a64fd0a90d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:51.037695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a5e5061-97d8-4331-a7ce-25a64fd0a90d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:51.065241 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7a5e5061-97d8-4331-a7ce-25a64fd0a90d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040665 Apr 07 17:27:51.066437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 416/843] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:51.945997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:51.946607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:51.953023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:51.953497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:51.954261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:51.954692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:52.013780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:52.022127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b99670ef-3a44-4905-a97d-d8d39b19b6fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080054 Apr 07 17:27:52.022688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 428/844] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:51 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:27:52.077160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-649882b5-fe21-4708-9f78-2655171c255c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:52.078080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-649882b5-fe21-4708-9f78-2655171c255c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:52.084912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-649882b5-fe21-4708-9f78-2655171c255c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:52.085383 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-649882b5-fe21-4708-9f78-2655171c255c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:52.086140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-649882b5-fe21-4708-9f78-2655171c255c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:52.086569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-649882b5-fe21-4708-9f78-2655171c255c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:52.115124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-649882b5-fe21-4708-9f78-2655171c255c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041848 Apr 07 17:27:52.115658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 417/845] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:53.039188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:53.039804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:53.046131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:53.046580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:53.047348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:53.047783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:53.106335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:53.114102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c8adc1f9-a726-4adb-9712-e0bc096ec79c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078927 Apr 07 17:27:53.114666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 429/846] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:53.126373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-850f5ee0-b39b-4a7b-ae16-74376a7c6a91 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:53.127282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-850f5ee0-b39b-4a7b-ae16-74376a7c6a91 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:53.134446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-850f5ee0-b39b-4a7b-ae16-74376a7c6a91 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:53.134889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-850f5ee0-b39b-4a7b-ae16-74376a7c6a91 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:53.135637 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-850f5ee0-b39b-4a7b-ae16-74376a7c6a91 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:53.136090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-850f5ee0-b39b-4a7b-ae16-74376a7c6a91 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:53.164764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-850f5ee0-b39b-4a7b-ae16-74376a7c6a91 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042224 Apr 07 17:27:53.165332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 418/847] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:53.811025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:27:53.811235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:27:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:27:54.132149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:54.132809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:54.139153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:54.139595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:54.140360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:54.140798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:54.176208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e9d25bad-5eda-4aaa-b49b-97335487b50b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:54.177158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e9d25bad-5eda-4aaa-b49b-97335487b50b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:54.183803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9d25bad-5eda-4aaa-b49b-97335487b50b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:54.184124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9d25bad-5eda-4aaa-b49b-97335487b50b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:54.184861 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9d25bad-5eda-4aaa-b49b-97335487b50b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:54.185325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9d25bad-5eda-4aaa-b49b-97335487b50b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:54.203349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:54.211595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8556de53-b228-4d4a-b22e-61e7e3660010 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084270 Apr 07 17:27:54.212548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 430/848] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:54 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:54.216487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e9d25bad-5eda-4aaa-b49b-97335487b50b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 Apr 07 17:27:54.217047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 419/849] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:55.228426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:55.229095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f24f0538-1c30-4b3a-b52f-e2b8743c49c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:55.229502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:55.229618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f24f0538-1c30-4b3a-b52f-e2b8743c49c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:55.235279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:55.235725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:55.235838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f24f0538-1c30-4b3a-b52f-e2b8743c49c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:55.236181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f24f0538-1c30-4b3a-b52f-e2b8743c49c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:55.236481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:55.236910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:55.237008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f24f0538-1c30-4b3a-b52f-e2b8743c49c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:55.237588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f24f0538-1c30-4b3a-b52f-e2b8743c49c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:55.267097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f24f0538-1c30-4b3a-b52f-e2b8743c49c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042414 Apr 07 17:27:55.267668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 431/850] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:55.298210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:55.305584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8753f6b4-2a8a-48d4-888d-6713ecbcf021 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080973 Apr 07 17:27:55.306144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 420/851] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:56.279528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4b1ef7c5-8620-4ca0-afcf-683ffd08f6bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:56.280424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4b1ef7c5-8620-4ca0-afcf-683ffd08f6bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:56.287687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b1ef7c5-8620-4ca0-afcf-683ffd08f6bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:56.288128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b1ef7c5-8620-4ca0-afcf-683ffd08f6bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:56.288886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b1ef7c5-8620-4ca0-afcf-683ffd08f6bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:56.289344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b1ef7c5-8620-4ca0-afcf-683ffd08f6bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:56.318321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4b1ef7c5-8620-4ca0-afcf-683ffd08f6bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Apr 07 17:27:56.318871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 432/852] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:56.322087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:56.322703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:56.328947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:56.329430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:56.330186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:56.330621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:56.390461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:56.397939 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6453111d-dc4f-4e4e-883e-22aeb4655386 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079702 Apr 07 17:27:56.398492 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 421/853] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:27:57.330116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c330e3ea-0a9d-41f0-9f7f-69932d75bd29 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:57.332043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c330e3ea-0a9d-41f0-9f7f-69932d75bd29 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:57.338323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c330e3ea-0a9d-41f0-9f7f-69932d75bd29 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:57.338768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c330e3ea-0a9d-41f0-9f7f-69932d75bd29 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:57.339522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c330e3ea-0a9d-41f0-9f7f-69932d75bd29 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:57.339952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c330e3ea-0a9d-41f0-9f7f-69932d75bd29 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:57.369346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c330e3ea-0a9d-41f0-9f7f-69932d75bd29 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043173 Apr 07 17:27:57.369885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 433/854] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:27:57.415139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:57.415741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:57.422024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:57.422468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:57.423218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:57.423648 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:57.483622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:57.490987 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2873641f-d33a-4372-8088-dbb30712c3f3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079643 Apr 07 17:27:57.491552 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 422/855] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:57 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:58.381913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-77b4a753-0cb6-4337-bbc7-f83a054ff4ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:58.382915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-77b4a753-0cb6-4337-bbc7-f83a054ff4ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:58.389246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77b4a753-0cb6-4337-bbc7-f83a054ff4ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:58.389700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77b4a753-0cb6-4337-bbc7-f83a054ff4ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:58.390472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77b4a753-0cb6-4337-bbc7-f83a054ff4ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:58.390910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77b4a753-0cb6-4337-bbc7-f83a054ff4ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:58.419355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-77b4a753-0cb6-4337-bbc7-f83a054ff4ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042099 Apr 07 17:27:58.419886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 434/856] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:58.507630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:58.508148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:58.514465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:58.514906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:58.515656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:58.516085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:58.576825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:58.584336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eabd6fc7-6eda-4c53-b3f0-a0e7dac60279 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080544 Apr 07 17:27:58.584889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 423/857] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:27:59.430890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-493fabe2-05c0-4be1-8e5e-a62780c9deb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:59.431814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-493fabe2-05c0-4be1-8e5e-a62780c9deb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:59.438067 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-493fabe2-05c0-4be1-8e5e-a62780c9deb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:59.438518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-493fabe2-05c0-4be1-8e5e-a62780c9deb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:59.439284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-493fabe2-05c0-4be1-8e5e-a62780c9deb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:59.439720 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-493fabe2-05c0-4be1-8e5e-a62780c9deb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:59.468620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-493fabe2-05c0-4be1-8e5e-a62780c9deb1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041699 Apr 07 17:27:59.469185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 435/858] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:27:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:27:59.599918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:27:59.600582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:27:59.606889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:59.607336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:59.608098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:27:59.608545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:27:59.672852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:27:59.681214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-76844cb1-1b68-4266-bb67-8119e6b7d4c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085038 Apr 07 17:27:59.681734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 424/859] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:27:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:00.480060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1efd9c89-001c-4934-96dc-22446421ba9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:00.480979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1efd9c89-001c-4934-96dc-22446421ba9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:00.487536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1efd9c89-001c-4934-96dc-22446421ba9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:00.487988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1efd9c89-001c-4934-96dc-22446421ba9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:00.488759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1efd9c89-001c-4934-96dc-22446421ba9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:00.489220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1efd9c89-001c-4934-96dc-22446421ba9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:00.517547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1efd9c89-001c-4934-96dc-22446421ba9d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041374 Apr 07 17:28:00.518724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 436/860] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:00.698651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:00.699264 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:00.705503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:00.706603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:00.707386 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:00.707824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:00.768872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:00.776686 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f8447d43-089c-4e70-ab8c-0af564036635 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081836 Apr 07 17:28:00.777337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 425/861] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:01.529621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7e04b285-8922-4363-9b6b-99eece5e29bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:01.530536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7e04b285-8922-4363-9b6b-99eece5e29bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:01.537074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7e04b285-8922-4363-9b6b-99eece5e29bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:01.537547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7e04b285-8922-4363-9b6b-99eece5e29bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:01.538308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7e04b285-8922-4363-9b6b-99eece5e29bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:01.538741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7e04b285-8922-4363-9b6b-99eece5e29bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:01.567775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7e04b285-8922-4363-9b6b-99eece5e29bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042119 Apr 07 17:28:01.568309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 437/862] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:01.792669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:01.793236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:01.799533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:01.799982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:01.800748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:01.801216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:01.859298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:01.866719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a9235c70-6372-479b-9303-d1c220911249 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078035 Apr 07 17:28:01.867278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 426/863] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:02.579268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e7771326-a81d-4d36-8f25-9328aa2a9d14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:02.580177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e7771326-a81d-4d36-8f25-9328aa2a9d14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:02.587008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7771326-a81d-4d36-8f25-9328aa2a9d14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:02.587464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7771326-a81d-4d36-8f25-9328aa2a9d14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:02.588220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7771326-a81d-4d36-8f25-9328aa2a9d14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:02.588650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7771326-a81d-4d36-8f25-9328aa2a9d14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:02.616828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e7771326-a81d-4d36-8f25-9328aa2a9d14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041492 Apr 07 17:28:02.617394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 438/864] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:02.883262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:02.883875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:02.890200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:02.890651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:02.891414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:02.891853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:02.951513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:02.959576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-05204da3-e926-4326-beec-3f83b7f3444b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080212 Apr 07 17:28:02.960146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 427/865] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:02 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:28:03.629243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-20a4ef24-fa51-4cc0-9b8c-baf159c3c93f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:03.630108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-20a4ef24-fa51-4cc0-9b8c-baf159c3c93f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:03.636395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20a4ef24-fa51-4cc0-9b8c-baf159c3c93f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:03.636828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20a4ef24-fa51-4cc0-9b8c-baf159c3c93f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:03.637624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20a4ef24-fa51-4cc0-9b8c-baf159c3c93f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:03.638066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20a4ef24-fa51-4cc0-9b8c-baf159c3c93f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:03.667275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-20a4ef24-fa51-4cc0-9b8c-baf159c3c93f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 Apr 07 17:28:03.667923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 439/866] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:03.976503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:03.977118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:03.983362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:03.983803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:03.984572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:03.985004 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:04.044682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:04.052119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f8f11d29-1bf1-42a8-af3b-847ac46945d6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079692 Apr 07 17:28:04.052672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 428/867] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:04.678929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0044bf94-90fe-4a6d-bd2a-3fa3b4991892 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:04.679848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0044bf94-90fe-4a6d-bd2a-3fa3b4991892 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:04.686221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0044bf94-90fe-4a6d-bd2a-3fa3b4991892 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:04.686609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0044bf94-90fe-4a6d-bd2a-3fa3b4991892 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:04.687373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0044bf94-90fe-4a6d-bd2a-3fa3b4991892 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:04.687810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0044bf94-90fe-4a6d-bd2a-3fa3b4991892 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:04.717372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0044bf94-90fe-4a6d-bd2a-3fa3b4991892 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042290 Apr 07 17:28:04.717947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 440/868] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:05.072049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:05.072600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:05.078556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:05.079003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:05.079754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:05.080186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:05.140030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:05.147375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1e679e3d-1152-4e14-8c31-63195d30a2ec tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079306 Apr 07 17:28:05.147926 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 429/869] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:05 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:05.728501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f44e853d-ed0a-42b3-bf1c-ce06b98ab873 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:05.729441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f44e853d-ed0a-42b3-bf1c-ce06b98ab873 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:05.735745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f44e853d-ed0a-42b3-bf1c-ce06b98ab873 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:05.736200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f44e853d-ed0a-42b3-bf1c-ce06b98ab873 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:05.737013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f44e853d-ed0a-42b3-bf1c-ce06b98ab873 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:05.737470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f44e853d-ed0a-42b3-bf1c-ce06b98ab873 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:05.768738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f44e853d-ed0a-42b3-bf1c-ce06b98ab873 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043696 Apr 07 17:28:05.769315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 441/870] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:06.163902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:06.164484 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:06.170862 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:06.171312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:06.172069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:06.172502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:06.230317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:06.237774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6fb43b20-fac4-4fef-82ad-e680b23c4cba tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077847 Apr 07 17:28:06.238339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 430/871] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:06 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:06.780600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a8e56ffb-41ea-4bcd-9a96-8cb7b20d811b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:06.781547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a8e56ffb-41ea-4bcd-9a96-8cb7b20d811b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:06.788371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8e56ffb-41ea-4bcd-9a96-8cb7b20d811b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:06.788824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8e56ffb-41ea-4bcd-9a96-8cb7b20d811b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:06.789617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8e56ffb-41ea-4bcd-9a96-8cb7b20d811b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:06.790058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8e56ffb-41ea-4bcd-9a96-8cb7b20d811b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:06.818106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a8e56ffb-41ea-4bcd-9a96-8cb7b20d811b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041474 Apr 07 17:28:06.818647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 442/872] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:07.254624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:07.255228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:07.261373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:07.261814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:07.268702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:07.268702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:07.324907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:07.333079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2cc8a7e2-9531-42a6-b0ab-7d9a88acddc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082767 Apr 07 17:28:07.333661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 431/873] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:07.829343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1351dd6c-a500-4aa6-8e6f-d0252fce4533 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:07.830263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1351dd6c-a500-4aa6-8e6f-d0252fce4533 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:07.837161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1351dd6c-a500-4aa6-8e6f-d0252fce4533 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:07.837620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1351dd6c-a500-4aa6-8e6f-d0252fce4533 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:07.838383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1351dd6c-a500-4aa6-8e6f-d0252fce4533 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:07.838817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1351dd6c-a500-4aa6-8e6f-d0252fce4533 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:07.866744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1351dd6c-a500-4aa6-8e6f-d0252fce4533 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041384 Apr 07 17:28:07.867288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 443/874] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:08.349688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:08.350327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:08.356600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:08.357048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:08.357837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:08.358269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:08.416599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:08.423913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-58d91ca3-bf91-413a-9a98-64940d8ad3ac tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078231 Apr 07 17:28:08.424738 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 432/875] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:08.878359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-62ae0850-f7d1-4094-862e-07c7548d654a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:08.879280 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-62ae0850-f7d1-4094-862e-07c7548d654a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:08.885786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62ae0850-f7d1-4094-862e-07c7548d654a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:08.886238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62ae0850-f7d1-4094-862e-07c7548d654a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:08.887005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62ae0850-f7d1-4094-862e-07c7548d654a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:08.887445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62ae0850-f7d1-4094-862e-07c7548d654a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:08.916593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-62ae0850-f7d1-4094-862e-07c7548d654a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042313 Apr 07 17:28:08.917158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 444/876] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:09.441656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:09.442266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:09.448462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:09.448906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:09.449688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:09.450120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:09.508418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:09.515838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e6126b7b-5b21-46d7-bcef-1b217f52aa46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078797 Apr 07 17:28:09.516406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 433/877] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:09 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:09.928698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8f7eaaab-1fcf-49ff-ab69-fd2ad7a3b675 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:09.929660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8f7eaaab-1fcf-49ff-ab69-fd2ad7a3b675 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:09.936216 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7eaaab-1fcf-49ff-ab69-fd2ad7a3b675 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:09.936690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7eaaab-1fcf-49ff-ab69-fd2ad7a3b675 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:09.937478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7eaaab-1fcf-49ff-ab69-fd2ad7a3b675 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:09.937913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7eaaab-1fcf-49ff-ab69-fd2ad7a3b675 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:09.967102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8f7eaaab-1fcf-49ff-ab69-fd2ad7a3b675 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043003 Apr 07 17:28:09.967653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 445/878] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:10.531716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:10.532319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:10.539625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:10.540073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:10.540839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:10.541305 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:10.603040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:10.610115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4c1e57cd-cc9d-41d9-b586-511c10d8a5a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082212 Apr 07 17:28:10.610674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 434/879] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:10.979291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cdde2c59-bc91-402c-862c-f3cb4658fd20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:10.980224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cdde2c59-bc91-402c-862c-f3cb4658fd20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:10.986687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cdde2c59-bc91-402c-862c-f3cb4658fd20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:10.987140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cdde2c59-bc91-402c-862c-f3cb4658fd20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:10.987913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cdde2c59-bc91-402c-862c-f3cb4658fd20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:10.988356 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cdde2c59-bc91-402c-862c-f3cb4658fd20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:11.016077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cdde2c59-bc91-402c-862c-f3cb4658fd20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040769 Apr 07 17:28:11.016620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 446/880] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:28:11.627864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:11.628461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:11.634694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:11.635142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:11.635896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:11.636326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:11.697614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:11.704781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e01c908a-0d42-4cce-8d31-41fb426510ad tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080946 Apr 07 17:28:11.705870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 435/881] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:12.028033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0694cb6f-df86-4bf6-90fc-7abc351e8393 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:12.028958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0694cb6f-df86-4bf6-90fc-7abc351e8393 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:12.036055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0694cb6f-df86-4bf6-90fc-7abc351e8393 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:12.036499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0694cb6f-df86-4bf6-90fc-7abc351e8393 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:12.037303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0694cb6f-df86-4bf6-90fc-7abc351e8393 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:12.037764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0694cb6f-df86-4bf6-90fc-7abc351e8393 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:12.066653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0694cb6f-df86-4bf6-90fc-7abc351e8393 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042869 Apr 07 17:28:12.067200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 447/882] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:12.774721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:12.775359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:12.781568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:12.782041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:12.782793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:12.783750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:12.842171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:12.850060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-feae3853-de96-4770-9372-6b2f23ddf1d9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079395 Apr 07 17:28:12.850606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 436/883] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:13.078256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8b1752ec-3fb2-4e1a-9c70-94acb21beac5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:13.079175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8b1752ec-3fb2-4e1a-9c70-94acb21beac5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:13.086156 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b1752ec-3fb2-4e1a-9c70-94acb21beac5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:13.086608 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b1752ec-3fb2-4e1a-9c70-94acb21beac5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:13.087374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b1752ec-3fb2-4e1a-9c70-94acb21beac5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:13.087811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b1752ec-3fb2-4e1a-9c70-94acb21beac5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:13.116443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8b1752ec-3fb2-4e1a-9c70-94acb21beac5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042229 Apr 07 17:28:13.117002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 448/884] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:13.867330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:13.867940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:13.874255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:13.874702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:13.875494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:13.875927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:13.936779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:13.944660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-50dd101c-435e-46f0-9bb5-0816082a6031 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081208 Apr 07 17:28:13.945239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 437/885] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:14.129058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-086789c0-cbbb-4cb9-bf73-df050073f3a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:14.130015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-086789c0-cbbb-4cb9-bf73-df050073f3a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:14.136259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-086789c0-cbbb-4cb9-bf73-df050073f3a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:14.136702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-086789c0-cbbb-4cb9-bf73-df050073f3a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:14.137493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-086789c0-cbbb-4cb9-bf73-df050073f3a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:14.137932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-086789c0-cbbb-4cb9-bf73-df050073f3a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:14.167301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-086789c0-cbbb-4cb9-bf73-df050073f3a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043364 Apr 07 17:28:14.167850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 449/886] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:14.962314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:14.962945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:14.969295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:14.969742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:14.970493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:14.971509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:15.031321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:15.039134 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3bc01f3b-4183-4af0-8689-d712e62ee9e6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080663 Apr 07 17:28:15.039694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 438/887] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:28:15.178243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d49ae607-93ce-4d66-bd90-d988a9f294e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:15.179228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d49ae607-93ce-4d66-bd90-d988a9f294e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:15.185505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d49ae607-93ce-4d66-bd90-d988a9f294e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:15.185961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d49ae607-93ce-4d66-bd90-d988a9f294e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:15.186731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d49ae607-93ce-4d66-bd90-d988a9f294e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:15.187174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d49ae607-93ce-4d66-bd90-d988a9f294e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:15.215892 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d49ae607-93ce-4d66-bd90-d988a9f294e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041680 Apr 07 17:28:15.216367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 450/888] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:16.055885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:16.056500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:16.062807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:16.063257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:16.064019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:16.064488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:16.123036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:16.130284 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c77fe715-e488-4d34-a4de-90a7d0c689fc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078279 Apr 07 17:28:16.130844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 439/889] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:16.227626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fd98deb0-06d2-43f5-8ee9-a74b21f85aac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:16.228574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fd98deb0-06d2-43f5-8ee9-a74b21f85aac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:16.235125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd98deb0-06d2-43f5-8ee9-a74b21f85aac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:16.235576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd98deb0-06d2-43f5-8ee9-a74b21f85aac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:16.236418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd98deb0-06d2-43f5-8ee9-a74b21f85aac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:16.236850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd98deb0-06d2-43f5-8ee9-a74b21f85aac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:16.265222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fd98deb0-06d2-43f5-8ee9-a74b21f85aac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041598 Apr 07 17:28:16.265780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 451/890] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:17.147120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:17.147727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:17.154262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:17.154713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:17.155471 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:17.155904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:17.213994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:17.221973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5e9e05c8-b926-4ff4-978c-dc2ec30c6fe5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078703 Apr 07 17:28:17.222526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 440/891] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:17.277684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2438ed89-6e6d-4c1e-a3d5-51797c889b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:17.278644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2438ed89-6e6d-4c1e-a3d5-51797c889b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:17.285701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2438ed89-6e6d-4c1e-a3d5-51797c889b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:17.286156 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2438ed89-6e6d-4c1e-a3d5-51797c889b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:17.287069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2438ed89-6e6d-4c1e-a3d5-51797c889b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:17.287511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2438ed89-6e6d-4c1e-a3d5-51797c889b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:17.320230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2438ed89-6e6d-4c1e-a3d5-51797c889b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Apr 07 17:28:17.320794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 452/892] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:18.237725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:18.238334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:18.244694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:18.245161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:18.245964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:18.246416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:18.307761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:18.322234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-88486535-baa9-42f2-aaf4-68eb42e2a0d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086284 Apr 07 17:28:18.322811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 441/893] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:18 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:18.331796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3f5827ac-4dad-4d8e-a099-c2bcc2a16955 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:18.332722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3f5827ac-4dad-4d8e-a099-c2bcc2a16955 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:18.339101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f5827ac-4dad-4d8e-a099-c2bcc2a16955 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:18.339555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f5827ac-4dad-4d8e-a099-c2bcc2a16955 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:18.340325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f5827ac-4dad-4d8e-a099-c2bcc2a16955 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:18.340761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f5827ac-4dad-4d8e-a099-c2bcc2a16955 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:18.369008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3f5827ac-4dad-4d8e-a099-c2bcc2a16955 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041231 Apr 07 17:28:18.369595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 453/894] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:18.569865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:28:18.570071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:28:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:28:19.339508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:19.340113 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:19.346659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:19.347111 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:19.347878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:19.348315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:19.380916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5362c1f2-c37f-4bf0-9430-63cbfc553933 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:19.382523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5362c1f2-c37f-4bf0-9430-63cbfc553933 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:19.388898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5362c1f2-c37f-4bf0-9430-63cbfc553933 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:19.389438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5362c1f2-c37f-4bf0-9430-63cbfc553933 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:19.390230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5362c1f2-c37f-4bf0-9430-63cbfc553933 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:19.390701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5362c1f2-c37f-4bf0-9430-63cbfc553933 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:19.409442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:19.416715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f035d02f-b456-4eba-95ca-63264dcac09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081060 Apr 07 17:28:19.417411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 442/895] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:19.421116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5362c1f2-c37f-4bf0-9430-63cbfc553933 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Apr 07 17:28:19.421693 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 454/896] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:28:20.432931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2b4849ee-7b65-4057-9f86-31a7dc7182b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:20.433549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:20.433913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:20.434002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2b4849ee-7b65-4057-9f86-31a7dc7182b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:20.440294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b4849ee-7b65-4057-9f86-31a7dc7182b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:20.440835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b4849ee-7b65-4057-9f86-31a7dc7182b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:20.440954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:20.441414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:20.441628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b4849ee-7b65-4057-9f86-31a7dc7182b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:20.442066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b4849ee-7b65-4057-9f86-31a7dc7182b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:20.442186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:20.442600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:20.469910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2b4849ee-7b65-4057-9f86-31a7dc7182b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040913 Apr 07 17:28:20.470964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 443/897] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:20.504425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:20.511674 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dca86e7f-34b7-487e-acbc-41a53f8e1cff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082321 Apr 07 17:28:20.512239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 455/898] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:28:21.481593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3b5fe553-22c5-483f-a2f3-ac05c0b21c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:21.482511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3b5fe553-22c5-483f-a2f3-ac05c0b21c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:21.489543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b5fe553-22c5-483f-a2f3-ac05c0b21c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:21.489992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b5fe553-22c5-483f-a2f3-ac05c0b21c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:21.490749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b5fe553-22c5-483f-a2f3-ac05c0b21c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:21.491182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b5fe553-22c5-483f-a2f3-ac05c0b21c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:21.519306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3b5fe553-22c5-483f-a2f3-ac05c0b21c26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041633 Apr 07 17:28:21.519844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 444/899] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:21.531830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:21.532441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:21.539258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:21.539704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:21.540462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:21.540888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:21.600072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:21.607275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f262b835-af3e-44e8-967a-ab9d14ec63fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079474 Apr 07 17:28:21.607826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 456/900] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:21 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:22.530364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-46aa064f-635f-4f9c-aefe-e444961d7f0a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:22.531308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-46aa064f-635f-4f9c-aefe-e444961d7f0a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:22.537891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-46aa064f-635f-4f9c-aefe-e444961d7f0a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:22.538341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-46aa064f-635f-4f9c-aefe-e444961d7f0a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:22.539102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-46aa064f-635f-4f9c-aefe-e444961d7f0a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:22.539536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-46aa064f-635f-4f9c-aefe-e444961d7f0a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:22.567560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-46aa064f-635f-4f9c-aefe-e444961d7f0a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041156 Apr 07 17:28:22.568099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 445/901] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:22.625228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:22.625834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:22.632602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:22.633044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:22.633833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:22.634263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:22.695009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:22.702436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e35ca513-765f-47a0-a5ce-ae4e8dda1077 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081014 Apr 07 17:28:22.703004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 457/902] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:23.578999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6a4d9198-7800-4901-babd-c5d5ddaeeda3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:23.580497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6a4d9198-7800-4901-babd-c5d5ddaeeda3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:23.587168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a4d9198-7800-4901-babd-c5d5ddaeeda3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:23.587640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a4d9198-7800-4901-babd-c5d5ddaeeda3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:23.588466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a4d9198-7800-4901-babd-c5d5ddaeeda3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:23.588900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6a4d9198-7800-4901-babd-c5d5ddaeeda3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:23.617575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6a4d9198-7800-4901-babd-c5d5ddaeeda3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Apr 07 17:28:23.618129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 446/903] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:23.719571 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:23.720184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:23.727018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:23.727469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:23.728238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:23.728672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:23.787220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:23.794464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-55062a6e-4272-4286-a461-184d57cb4269 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078746 Apr 07 17:28:23.795022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 458/904] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:24.628921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0941b0e1-6d98-4428-adb4-43cdd64ae2b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:24.629849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0941b0e1-6d98-4428-adb4-43cdd64ae2b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:24.636090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0941b0e1-6d98-4428-adb4-43cdd64ae2b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:24.636535 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0941b0e1-6d98-4428-adb4-43cdd64ae2b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:24.637322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0941b0e1-6d98-4428-adb4-43cdd64ae2b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:24.637754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0941b0e1-6d98-4428-adb4-43cdd64ae2b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:24.667073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0941b0e1-6d98-4428-adb4-43cdd64ae2b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042688 Apr 07 17:28:24.667627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 447/905] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:24.810968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:24.811573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:24.818880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:24.819333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:24.820088 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:24.820522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:24.880318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:24.887735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-21a6f4be-7955-4f79-82ac-fab294cd5508 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080603 Apr 07 17:28:24.888298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 459/906] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:25.678753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e7ac4a25-026f-4b2b-acc4-fd7352d77d9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:25.679671 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e7ac4a25-026f-4b2b-acc4-fd7352d77d9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:25.685981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7ac4a25-026f-4b2b-acc4-fd7352d77d9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:25.686431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7ac4a25-026f-4b2b-acc4-fd7352d77d9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:25.687191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7ac4a25-026f-4b2b-acc4-fd7352d77d9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:25.687628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7ac4a25-026f-4b2b-acc4-fd7352d77d9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:25.716144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e7ac4a25-026f-4b2b-acc4-fd7352d77d9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041329 Apr 07 17:28:25.716691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 448/907] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:25.905581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:25.906126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:25.913185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:25.913641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:25.914407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:25.914843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:25.973238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:25.980563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9565eed5-a225-48c2-a051-5e37f7fde44c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078909 Apr 07 17:28:25.981128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 460/908] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:26.620596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:28:26.620825 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:28:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:28:26.727717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9438a2f3-6b68-4183-8141-33793aab36b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:26.728629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9438a2f3-6b68-4183-8141-33793aab36b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:26.734846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9438a2f3-6b68-4183-8141-33793aab36b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:26.735286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9438a2f3-6b68-4183-8141-33793aab36b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:26.736996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9438a2f3-6b68-4183-8141-33793aab36b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:26.737463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9438a2f3-6b68-4183-8141-33793aab36b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:26.765312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9438a2f3-6b68-4183-8141-33793aab36b7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041498 Apr 07 17:28:26.765844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 449/909] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:26.997042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:26.997680 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:27.004076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:27.004521 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:27.005317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:27.005753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:27.067579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:27.074901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-23ce0017-e5a1-42b2-84a6-b5b0447a84d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081678 Apr 07 17:28:27.075454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 461/910] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:27.777548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f3d08f0a-d510-4c5c-b8a4-9279c1705a13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:27.778477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f3d08f0a-d510-4c5c-b8a4-9279c1705a13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:27.784678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f3d08f0a-d510-4c5c-b8a4-9279c1705a13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:27.785120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f3d08f0a-d510-4c5c-b8a4-9279c1705a13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:27.785897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f3d08f0a-d510-4c5c-b8a4-9279c1705a13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:27.786331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f3d08f0a-d510-4c5c-b8a4-9279c1705a13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:27.813726 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f3d08f0a-d510-4c5c-b8a4-9279c1705a13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040356 Apr 07 17:28:27.815178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 450/911] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:28.091748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:28.092361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:28.098728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:28.099180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:28.099948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:28.100382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:28.162121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:28.169446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f1c40fc1-56e1-4034-a3e8-81768eea4ff6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081568 Apr 07 17:28:28.170000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 462/912] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:28.826225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ff7b1407-76e2-4bc5-9869-e302cf8a78f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:28.827162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ff7b1407-76e2-4bc5-9869-e302cf8a78f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:28.834570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff7b1407-76e2-4bc5-9869-e302cf8a78f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:28.835016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff7b1407-76e2-4bc5-9869-e302cf8a78f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:28.835761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff7b1407-76e2-4bc5-9869-e302cf8a78f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:28.836188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff7b1407-76e2-4bc5-9869-e302cf8a78f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:28.864580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ff7b1407-76e2-4bc5-9869-e302cf8a78f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042348 Apr 07 17:28:28.865125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 451/913] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:29.186751 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:29.187355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:29.194347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:29.194795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:29.195557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:29.195992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:29.259932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:29.268445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a21ae189-b02a-4f04-ae99-9c3769a33260 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084331 Apr 07 17:28:29.269000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 463/914] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:29 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:29.876017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-128e67b4-c968-487e-9895-f0638a03a4cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:29.877271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-128e67b4-c968-487e-9895-f0638a03a4cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:29.888325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-128e67b4-c968-487e-9895-f0638a03a4cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:29.888781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-128e67b4-c968-487e-9895-f0638a03a4cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:29.889575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-128e67b4-c968-487e-9895-f0638a03a4cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:29.890035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-128e67b4-c968-487e-9895-f0638a03a4cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:29.919195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-128e67b4-c968-487e-9895-f0638a03a4cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Apr 07 17:28:29.919735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 452/915] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:30.285455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:30.285997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:30.292276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:30.292724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:30.293552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:30.293988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:30.354566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:30.362528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a372c31d-f7e8-417a-801c-13f2f3efcbcb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081207 Apr 07 17:28:30.363082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 464/916] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:30.930337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fc2fa1d7-2e7e-4f7d-94b8-e03f1024e9aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:30.931258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fc2fa1d7-2e7e-4f7d-94b8-e03f1024e9aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:30.937488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc2fa1d7-2e7e-4f7d-94b8-e03f1024e9aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:30.937930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc2fa1d7-2e7e-4f7d-94b8-e03f1024e9aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:30.938682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc2fa1d7-2e7e-4f7d-94b8-e03f1024e9aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:30.939662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc2fa1d7-2e7e-4f7d-94b8-e03f1024e9aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:30.967522 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fc2fa1d7-2e7e-4f7d-94b8-e03f1024e9aa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041090 Apr 07 17:28:30.968063 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 453/917] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:31.379206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:31.379771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:31.385727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:31.386177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:31.386938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:31.387374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:31.445679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:31.452950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6c4533e7-7b35-4021-ac5d-7b926fac6a74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078506 Apr 07 17:28:31.453556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 465/918] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:31.979593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-175d99e0-b4d9-4b4a-9011-83fed226b22c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:31.980553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-175d99e0-b4d9-4b4a-9011-83fed226b22c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:31.986940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175d99e0-b4d9-4b4a-9011-83fed226b22c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:31.987391 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175d99e0-b4d9-4b4a-9011-83fed226b22c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:31.988155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175d99e0-b4d9-4b4a-9011-83fed226b22c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:31.988597 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175d99e0-b4d9-4b4a-9011-83fed226b22c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:32.016467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-175d99e0-b4d9-4b4a-9011-83fed226b22c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 Apr 07 17:28:32.017619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 454/919] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:32.469878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:32.470676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:32.477011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:32.477493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:32.478258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:32.478702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:32.537195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:32.544540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f423227e-df98-4dc4-bd53-295f2af3081f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078522 Apr 07 17:28:32.545093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 466/920] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:32 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:32.682637 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:28:32.682824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:28:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:28:33.028252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-84de7296-9d07-4547-ac19-326261f170fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:33.029126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-84de7296-9d07-4547-ac19-326261f170fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:33.036317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84de7296-9d07-4547-ac19-326261f170fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:33.036759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84de7296-9d07-4547-ac19-326261f170fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:33.037548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84de7296-9d07-4547-ac19-326261f170fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:33.037975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-84de7296-9d07-4547-ac19-326261f170fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:33.066879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-84de7296-9d07-4547-ac19-326261f170fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042847 Apr 07 17:28:33.067417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 455/921] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:33.561759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:33.562401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:33.568886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:33.569383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:33.570150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:33.570591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:33.635289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:33.643333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-47ff2c37-b098-4224-8229-7bc9dee80d70 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085446 Apr 07 17:28:33.644012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 467/922] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:34.078370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-303d7e61-4253-417f-875c-462a6a821553 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:34.079291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-303d7e61-4253-417f-875c-462a6a821553 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:34.085601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-303d7e61-4253-417f-875c-462a6a821553 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:34.086052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-303d7e61-4253-417f-875c-462a6a821553 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:34.086809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-303d7e61-4253-417f-875c-462a6a821553 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:34.087271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-303d7e61-4253-417f-875c-462a6a821553 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:34.114712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-303d7e61-4253-417f-875c-462a6a821553 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040283 Apr 07 17:28:34.115242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 456/923] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:34.659833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:34.660447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:34.666738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:34.667188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:34.667948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:34.668388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:34.727078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:34.734387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d4310620-ff5f-46da-ab63-4b4d2cc69c48 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078559 Apr 07 17:28:34.734952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 468/924] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:34 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:35.126930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bc3c1291-ea7b-4799-a5b9-dd7d5fe82e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:35.127758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bc3c1291-ea7b-4799-a5b9-dd7d5fe82e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:35.133725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc3c1291-ea7b-4799-a5b9-dd7d5fe82e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:35.134168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc3c1291-ea7b-4799-a5b9-dd7d5fe82e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:35.134918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc3c1291-ea7b-4799-a5b9-dd7d5fe82e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:35.135347 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc3c1291-ea7b-4799-a5b9-dd7d5fe82e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:35.163702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bc3c1291-ea7b-4799-a5b9-dd7d5fe82e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041471 Apr 07 17:28:35.165885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 457/925] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:35.750984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:35.752321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:35.758671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:35.759123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:35.759888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:35.760333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:35.819063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:35.826367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9e9d92ae-9a4e-45ea-9c0b-63fc1e3fa07d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079227 Apr 07 17:28:35.826935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 469/926] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:36.176121 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0e798622-8be4-490a-929f-64553bc9dd48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:36.177070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0e798622-8be4-490a-929f-64553bc9dd48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:36.186304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e798622-8be4-490a-929f-64553bc9dd48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:36.186938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e798622-8be4-490a-929f-64553bc9dd48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:36.187708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e798622-8be4-490a-929f-64553bc9dd48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:36.188139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e798622-8be4-490a-929f-64553bc9dd48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:36.215442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0e798622-8be4-490a-929f-64553bc9dd48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Apr 07 17:28:36.215972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 458/927] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:36.842580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:36.843193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:36.850142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:36.850598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:36.851366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:36.851809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:36.911212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:36.918515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-31e95b1b-e6ee-4032-be4d-9962b00cc669 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079852 Apr 07 17:28:36.919073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 470/928] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:37.227242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e9855d9b-cc0c-4b8e-86ce-f913c7343469 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:37.228192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e9855d9b-cc0c-4b8e-86ce-f913c7343469 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:37.234445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9855d9b-cc0c-4b8e-86ce-f913c7343469 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:37.234897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9855d9b-cc0c-4b8e-86ce-f913c7343469 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:37.235665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9855d9b-cc0c-4b8e-86ce-f913c7343469 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:37.236099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9855d9b-cc0c-4b8e-86ce-f913c7343469 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:37.263358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e9855d9b-cc0c-4b8e-86ce-f913c7343469 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040108 Apr 07 17:28:37.263898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 459/929] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:37.935956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:37.936563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:37.944006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:37.944451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:37.945228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:37.945669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:38.005891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:38.012936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-67c49d8b-087e-4ddc-9c25-ff0b82e2b3e7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080907 Apr 07 17:28:38.013518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 471/930] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:38.276121 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-234dd6cf-0673-4416-af67-092d84d36ddd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:38.277039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-234dd6cf-0673-4416-af67-092d84d36ddd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:38.283578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-234dd6cf-0673-4416-af67-092d84d36ddd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:38.284020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-234dd6cf-0673-4416-af67-092d84d36ddd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:38.284787 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-234dd6cf-0673-4416-af67-092d84d36ddd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:38.285255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-234dd6cf-0673-4416-af67-092d84d36ddd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:38.312522 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-234dd6cf-0673-4416-af67-092d84d36ddd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040617 Apr 07 17:28:38.313061 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 460/931] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:39.030387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:39.030994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:39.037925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:39.040540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:39.040540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:39.040540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:39.099494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:39.106805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-68a323c8-ce7a-459e-b0af-e7d9433e9658 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080180 Apr 07 17:28:39.107361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 472/932] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:39.324688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6e416535-ef99-49da-9690-a245faf27e40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:39.325575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6e416535-ef99-49da-9690-a245faf27e40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:39.332318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e416535-ef99-49da-9690-a245faf27e40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:39.332763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e416535-ef99-49da-9690-a245faf27e40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:39.333546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e416535-ef99-49da-9690-a245faf27e40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:39.333980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e416535-ef99-49da-9690-a245faf27e40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:39.361694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6e416535-ef99-49da-9690-a245faf27e40 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041072 Apr 07 17:28:39.362227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 461/933] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:40.124033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:40.124646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:40.130903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:40.131351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:40.132107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:40.132536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:40.193221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:40.200701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c9b285ad-17a9-4415-bfdf-8eb4134256ef tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080545 Apr 07 17:28:40.201278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 473/934] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:40.373336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2e951b24-eb60-460d-9340-e807806c3b12 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:40.374298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2e951b24-eb60-460d-9340-e807806c3b12 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:40.380765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e951b24-eb60-460d-9340-e807806c3b12 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:40.381247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e951b24-eb60-460d-9340-e807806c3b12 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:40.382005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e951b24-eb60-460d-9340-e807806c3b12 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:40.382442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e951b24-eb60-460d-9340-e807806c3b12 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:40.410992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2e951b24-eb60-460d-9340-e807806c3b12 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041639 Apr 07 17:28:40.411525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 462/935] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:41.218283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:41.218892 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:41.225999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:41.226451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:41.227225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:41.227662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:41.286110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:41.293337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6df49233-5b30-4ca7-a7cf-1c16d8179974 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079027 Apr 07 17:28:41.293902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 474/936] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:41.421350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ec243898-3936-49cf-a2f4-5c12a1bf04fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:41.422272 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ec243898-3936-49cf-a2f4-5c12a1bf04fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:41.429267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec243898-3936-49cf-a2f4-5c12a1bf04fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:41.429716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec243898-3936-49cf-a2f4-5c12a1bf04fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:41.430473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec243898-3936-49cf-a2f4-5c12a1bf04fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:41.430910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec243898-3936-49cf-a2f4-5c12a1bf04fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:41.458611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ec243898-3936-49cf-a2f4-5c12a1bf04fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041201 Apr 07 17:28:41.459152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 463/937] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:42.310643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:42.311255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:42.318255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:42.318703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:42.319463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:42.319901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:42.377976 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:42.385323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aa62aa6e-2620-4725-885e-db99bcdefc78 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078498 Apr 07 17:28:42.385883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 475/938] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:42 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:42.470196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-475927b8-29b5-4922-9969-22b01bb0039c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:42.471056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-475927b8-29b5-4922-9969-22b01bb0039c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:42.477328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-475927b8-29b5-4922-9969-22b01bb0039c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:42.477775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-475927b8-29b5-4922-9969-22b01bb0039c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:42.478535 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-475927b8-29b5-4922-9969-22b01bb0039c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:42.478972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-475927b8-29b5-4922-9969-22b01bb0039c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:42.507288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-475927b8-29b5-4922-9969-22b01bb0039c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041245 Apr 07 17:28:42.507829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 464/939] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:43.402222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:43.402858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:43.409629 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:43.410081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:43.410841 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:43.411279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:43.470938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:43.478625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b57eae0b-a0be-48e5-a59e-941c9cf0c355 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080538 Apr 07 17:28:43.479200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 476/940] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:43 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:43.518994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4af27568-c4e7-4778-a067-6e7e5b335ce4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:43.519907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4af27568-c4e7-4778-a067-6e7e5b335ce4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:43.526339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4af27568-c4e7-4778-a067-6e7e5b335ce4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:43.526785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4af27568-c4e7-4778-a067-6e7e5b335ce4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:43.527546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4af27568-c4e7-4778-a067-6e7e5b335ce4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:43.527979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4af27568-c4e7-4778-a067-6e7e5b335ce4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:43.557516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4af27568-c4e7-4778-a067-6e7e5b335ce4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042797 Apr 07 17:28:43.558055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 465/941] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:44.495743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:44.496354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:44.503366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:44.503818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:44.504615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:44.505050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:44.566274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:44.569652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-53865ba0-128e-4c78-b8b8-3b89521482b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:44.570569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-53865ba0-128e-4c78-b8b8-3b89521482b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:44.573721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c8858a4a-9ae0-4553-a24e-75977b9e6b4f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081835 Apr 07 17:28:44.574285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 477/942] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:44 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:44.576882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53865ba0-128e-4c78-b8b8-3b89521482b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:44.577373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53865ba0-128e-4c78-b8b8-3b89521482b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:44.578142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53865ba0-128e-4c78-b8b8-3b89521482b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:44.578578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53865ba0-128e-4c78-b8b8-3b89521482b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:44.606651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-53865ba0-128e-4c78-b8b8-3b89521482b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041480 Apr 07 17:28:44.607183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 466/943] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:28:45.591039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:45.591657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:45.598167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:45.598620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:45.599392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:45.599832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:45.618001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-61845e5d-0d05-4bbf-a23f-0c1960344166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:45.618921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61845e5d-0d05-4bbf-a23f-0c1960344166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:45.625123 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61845e5d-0d05-4bbf-a23f-0c1960344166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:45.625603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61845e5d-0d05-4bbf-a23f-0c1960344166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:45.626364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61845e5d-0d05-4bbf-a23f-0c1960344166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:45.626800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61845e5d-0d05-4bbf-a23f-0c1960344166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:45.657525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-61845e5d-0d05-4bbf-a23f-0c1960344166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043390 Apr 07 17:28:45.658082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 467/944] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:28:45.659184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:45.666865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8aa76be0-46ef-463b-9d9a-45ade623019d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079672 Apr 07 17:28:45.667446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 478/945] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:46.670194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1663fed5-795c-41ed-b418-431e089905c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:46.671108 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1663fed5-795c-41ed-b418-431e089905c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:46.678013 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1663fed5-795c-41ed-b418-431e089905c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:46.678458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1663fed5-795c-41ed-b418-431e089905c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:46.679222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1663fed5-795c-41ed-b418-431e089905c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:46.679650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1663fed5-795c-41ed-b418-431e089905c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:46.683846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:46.684466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:46.691342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:46.691791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:46.692569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:46.693020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:46.708102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1663fed5-795c-41ed-b418-431e089905c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041800 Apr 07 17:28:46.708658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 468/946] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:46.754304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:46.761596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5faaaa4a-2ea4-4776-9a4d-0b21dbcad478 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081478 Apr 07 17:28:46.762157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 479/947] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:46 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:28:47.719647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3f07dad1-32f2-4cc9-9deb-c8b1bb75b41f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:47.720577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3f07dad1-32f2-4cc9-9deb-c8b1bb75b41f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:47.727072 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f07dad1-32f2-4cc9-9deb-c8b1bb75b41f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:47.727520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f07dad1-32f2-4cc9-9deb-c8b1bb75b41f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:47.728324 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f07dad1-32f2-4cc9-9deb-c8b1bb75b41f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:47.728764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f07dad1-32f2-4cc9-9deb-c8b1bb75b41f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:47.756590 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3f07dad1-32f2-4cc9-9deb-c8b1bb75b41f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040890 Apr 07 17:28:47.757158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 469/948] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:47.778301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:47.778945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:47.785181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:47.785636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:47.786395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:47.786830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:47.844836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:47.852393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ef2dc8ae-bc87-4c33-8213-71def8b2a1fe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077892 Apr 07 17:28:47.852961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 480/949] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:48.768140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-117211e7-8679-49b9-813d-129bdb104f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:48.769065 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-117211e7-8679-49b9-813d-129bdb104f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:48.775690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117211e7-8679-49b9-813d-129bdb104f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:48.776169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117211e7-8679-49b9-813d-129bdb104f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:48.776937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117211e7-8679-49b9-813d-129bdb104f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:48.777406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117211e7-8679-49b9-813d-129bdb104f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:48.805418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-117211e7-8679-49b9-813d-129bdb104f89 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041242 Apr 07 17:28:48.805961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 470/950] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:48.868906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:48.869664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:48.876005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:48.876463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:48.877933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:48.878377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:48.936428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:48.944694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f2ca7273-d271-49c7-9f0e-cd416f0a5bc7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079678 Apr 07 17:28:48.945278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 481/951] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:49.817016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-68cdc088-0183-4d31-a4d4-f568f94038b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:49.817962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-68cdc088-0183-4d31-a4d4-f568f94038b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:49.824147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68cdc088-0183-4d31-a4d4-f568f94038b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:49.824590 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68cdc088-0183-4d31-a4d4-f568f94038b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:49.825363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68cdc088-0183-4d31-a4d4-f568f94038b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:49.825796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68cdc088-0183-4d31-a4d4-f568f94038b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:49.854632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-68cdc088-0183-4d31-a4d4-f568f94038b0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042510 Apr 07 17:28:49.855163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 471/952] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:49.961849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:49.963444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:49.969769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:49.970221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:49.970988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:49.971444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:50.029412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:50.036595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9a84a89a-f2d6-4b7a-9c4a-7d4fe99cd3b1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078596 Apr 07 17:28:50.037178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 482/953] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:50.866221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-57aefd35-f0d2-4dc7-88c1-458fff428c0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:50.867133 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-57aefd35-f0d2-4dc7-88c1-458fff428c0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:50.873526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57aefd35-f0d2-4dc7-88c1-458fff428c0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:50.874006 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57aefd35-f0d2-4dc7-88c1-458fff428c0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:50.874768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57aefd35-f0d2-4dc7-88c1-458fff428c0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:50.875225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57aefd35-f0d2-4dc7-88c1-458fff428c0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:50.904610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-57aefd35-f0d2-4dc7-88c1-458fff428c0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 Apr 07 17:28:50.905112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 472/954] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:51.053795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:51.054415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:51.060659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:51.061116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:51.061916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:51.062358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:51.121250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:51.129226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f86c7133-f3ee-4a46-9609-e0a54e000115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079967 Apr 07 17:28:51.129793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 483/955] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:51 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:51.916091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d4732c44-694f-414d-bdd2-4fb253d5607d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:51.917041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d4732c44-694f-414d-bdd2-4fb253d5607d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:51.923285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4732c44-694f-414d-bdd2-4fb253d5607d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:51.923730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4732c44-694f-414d-bdd2-4fb253d5607d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:51.925002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4732c44-694f-414d-bdd2-4fb253d5607d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:51.925455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4732c44-694f-414d-bdd2-4fb253d5607d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:51.953075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d4732c44-694f-414d-bdd2-4fb253d5607d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040921 Apr 07 17:28:51.953642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 473/956] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:52.146048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:52.146685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:52.153245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:52.153700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:52.154466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:52.154906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:52.213668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:52.220918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4df5d9c5-3000-46bb-a86b-23fe7b83c111 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078853 Apr 07 17:28:52.222115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 484/957] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:52 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:52.964772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7bb24e6b-450c-4a52-82e4-4462942b8703 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:52.965702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7bb24e6b-450c-4a52-82e4-4462942b8703 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:52.972413 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bb24e6b-450c-4a52-82e4-4462942b8703 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:52.972856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bb24e6b-450c-4a52-82e4-4462942b8703 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:52.973637 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bb24e6b-450c-4a52-82e4-4462942b8703 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:52.974066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7bb24e6b-450c-4a52-82e4-4462942b8703 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:53.001633 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7bb24e6b-450c-4a52-82e4-4462942b8703 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040630 Apr 07 17:28:53.002176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 474/958] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:53.237584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:53.238122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:53.244522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:53.244972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:53.245777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:53.246216 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:53.307566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:53.314938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dd833357-3ed3-4a4c-9971-920509260c1a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081331 Apr 07 17:28:53.315526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 485/959] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:54.013360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c3fe13dd-b4d0-4061-ad2d-9504c8a91ce8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:54.014277 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c3fe13dd-b4d0-4061-ad2d-9504c8a91ce8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:54.020864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3fe13dd-b4d0-4061-ad2d-9504c8a91ce8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:54.021330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3fe13dd-b4d0-4061-ad2d-9504c8a91ce8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:54.022082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3fe13dd-b4d0-4061-ad2d-9504c8a91ce8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:54.022511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3fe13dd-b4d0-4061-ad2d-9504c8a91ce8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:54.052464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c3fe13dd-b4d0-4061-ad2d-9504c8a91ce8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042959 Apr 07 17:28:54.053019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 475/960] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:54.331827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:54.332357 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:54.338782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:54.339239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:54.340017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:54.340474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:54.399092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:54.406415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-870f1d70-a0e7-4dee-a16a-43f7b32dba77 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078556 Apr 07 17:28:54.406978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 486/961] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:54 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:55.063897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c303743-3c41-41e9-8355-8d764f763ab2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:55.064818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5c303743-3c41-41e9-8355-8d764f763ab2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:55.071763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c303743-3c41-41e9-8355-8d764f763ab2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:55.072237 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c303743-3c41-41e9-8355-8d764f763ab2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:55.073000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c303743-3c41-41e9-8355-8d764f763ab2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:55.073464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c303743-3c41-41e9-8355-8d764f763ab2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:55.102720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5c303743-3c41-41e9-8355-8d764f763ab2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Apr 07 17:28:55.103288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 476/962] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:55.423248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:55.423857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:55.431394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:55.431889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:55.432764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:55.433410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:55.491991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:55.499520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8f3767a0-f79a-45aa-ac04-e849bdc02c83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080123 Apr 07 17:28:55.500098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 487/963] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:56.114532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-33701647-6658-49b6-a9f2-44d6c75c88f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:56.115451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-33701647-6658-49b6-a9f2-44d6c75c88f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:56.121829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33701647-6658-49b6-a9f2-44d6c75c88f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:56.122279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33701647-6658-49b6-a9f2-44d6c75c88f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:56.123042 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33701647-6658-49b6-a9f2-44d6c75c88f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:56.123479 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-33701647-6658-49b6-a9f2-44d6c75c88f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:56.155211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-33701647-6658-49b6-a9f2-44d6c75c88f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Apr 07 17:28:56.155788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 477/964] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:56.516803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:56.517365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:56.525013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:56.525492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:56.526249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:56.526682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:56.585113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:56.592524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-74087b72-94de-4e34-9aaa-3a3f466217ab tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079634 Apr 07 17:28:56.593087 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 488/965] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:57.166753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4ced6106-c618-4391-b620-4cc0ce61cf76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:57.167750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4ced6106-c618-4391-b620-4cc0ce61cf76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:57.174036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ced6106-c618-4391-b620-4cc0ce61cf76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:57.175077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ced6106-c618-4391-b620-4cc0ce61cf76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:57.175837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ced6106-c618-4391-b620-4cc0ce61cf76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:57.176269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ced6106-c618-4391-b620-4cc0ce61cf76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:57.204135 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4ced6106-c618-4391-b620-4cc0ce61cf76 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041341 Apr 07 17:28:57.204665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 478/966] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:57.625344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:57.625344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:57.625344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:57.625344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:57.626145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:57.626145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:57.679230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:57.686694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cbd2292f-eedb-4bc7-8f3a-41a5bd29ced4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081143 Apr 07 17:28:57.687260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 489/967] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:57 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:58.215475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-29801dbc-4f77-45d4-b2e0-0b80ff7cbe3a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:58.216382 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-29801dbc-4f77-45d4-b2e0-0b80ff7cbe3a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:58.223657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29801dbc-4f77-45d4-b2e0-0b80ff7cbe3a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:58.224185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29801dbc-4f77-45d4-b2e0-0b80ff7cbe3a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:58.225087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29801dbc-4f77-45d4-b2e0-0b80ff7cbe3a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:58.225626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29801dbc-4f77-45d4-b2e0-0b80ff7cbe3a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:58.253997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-29801dbc-4f77-45d4-b2e0-0b80ff7cbe3a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042338 Apr 07 17:28:58.254538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 479/968] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:58.703146 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:58.703747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:58.711105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:58.711546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:58.712299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:58.712734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:58.774795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:58.782106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6f1495be-595a-452f-82b0-df1730aec473 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083171 Apr 07 17:28:58.782670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 490/969] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:28:59.265989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c3820a81-b152-4660-8529-5f878896b2da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:59.266937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c3820a81-b152-4660-8529-5f878896b2da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:59.274138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3820a81-b152-4660-8529-5f878896b2da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:59.274583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3820a81-b152-4660-8529-5f878896b2da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:59.275336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3820a81-b152-4660-8529-5f878896b2da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:59.275766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3820a81-b152-4660-8529-5f878896b2da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:59.303461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c3820a81-b152-4660-8529-5f878896b2da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041559 Apr 07 17:28:59.303993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 480/970] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:28:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:28:59.798265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:28:59.798875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:28:59.806056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:59.806505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:59.807276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:28:59.807707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:28:59.868601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:28:59.875949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bcb222b5-5ee0-4a44-85ab-ab287811eaf7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081543 Apr 07 17:28:59.876507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 491/971] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:28:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:00.316231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c7d97e26-5d45-4968-9a17-c15e26a6ffe4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:00.317178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c7d97e26-5d45-4968-9a17-c15e26a6ffe4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:00.323698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c7d97e26-5d45-4968-9a17-c15e26a6ffe4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:00.324152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c7d97e26-5d45-4968-9a17-c15e26a6ffe4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:00.324922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c7d97e26-5d45-4968-9a17-c15e26a6ffe4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:00.325387 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c7d97e26-5d45-4968-9a17-c15e26a6ffe4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:00.353534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c7d97e26-5d45-4968-9a17-c15e26a6ffe4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041797 Apr 07 17:29:00.354079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 481/972] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:00.892694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:00.893756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:00.899988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:00.900436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:00.901223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:00.901661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:00.960553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:00.967894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4477d1cb-cd4f-4e87-b678-fd7e58179380 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079103 Apr 07 17:29:00.968451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 492/973] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:01.365882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a5424e47-293b-4b29-9495-6291caecd184 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:01.366802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a5424e47-293b-4b29-9495-6291caecd184 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:01.373095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5424e47-293b-4b29-9495-6291caecd184 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:01.373576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5424e47-293b-4b29-9495-6291caecd184 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:01.374337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5424e47-293b-4b29-9495-6291caecd184 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:01.374771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a5424e47-293b-4b29-9495-6291caecd184 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:01.402914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a5424e47-293b-4b29-9495-6291caecd184 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041687 Apr 07 17:29:01.403453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 482/974] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:01.986395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:01.988140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:01.996168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:01.996630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:01.997438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:01.997883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:02.063404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:02.072979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-90e3871a-265c-4f70-849a-5bb20eafe958 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.092173 Apr 07 17:29:02.073625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 493/975] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:02.415044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4d3ae9b6-4ec7-41d1-9f84-acd33fc63489 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:02.415961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4d3ae9b6-4ec7-41d1-9f84-acd33fc63489 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:02.422377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d3ae9b6-4ec7-41d1-9f84-acd33fc63489 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:02.422819 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d3ae9b6-4ec7-41d1-9f84-acd33fc63489 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:02.423570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d3ae9b6-4ec7-41d1-9f84-acd33fc63489 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:02.424003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d3ae9b6-4ec7-41d1-9f84-acd33fc63489 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:02.451489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4d3ae9b6-4ec7-41d1-9f84-acd33fc63489 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040327 Apr 07 17:29:02.452025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 483/976] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:03.091416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:03.092032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:03.098619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:03.099075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:03.099845 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:03.100288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:03.168982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:03.168982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-49593138-a717-4220-bcfc-462d6d77057b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081173 Apr 07 17:29:03.169319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 494/977] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:03.463074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7b77286b-3a1f-4224-b5b7-d4e4bd51b604 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:03.463910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7b77286b-3a1f-4224-b5b7-d4e4bd51b604 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:03.470247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7b77286b-3a1f-4224-b5b7-d4e4bd51b604 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:03.470693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7b77286b-3a1f-4224-b5b7-d4e4bd51b604 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:03.472077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7b77286b-3a1f-4224-b5b7-d4e4bd51b604 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:03.472515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7b77286b-3a1f-4224-b5b7-d4e4bd51b604 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:03.500227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7b77286b-3a1f-4224-b5b7-d4e4bd51b604 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041175 Apr 07 17:29:03.500779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 484/978] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:04.186756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:04.187401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:04.194359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:04.194811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:04.195578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:04.196019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:04.254596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:04.261782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b32388e6-8f64-41ce-83f8-ca6d9781a183 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078924 Apr 07 17:29:04.262347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 495/979] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:04 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:04.512003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0e6e96b5-77ee-4280-acb2-c4b9ce861c32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:04.512875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0e6e96b5-77ee-4280-acb2-c4b9ce861c32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:04.519194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e6e96b5-77ee-4280-acb2-c4b9ce861c32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:04.519641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e6e96b5-77ee-4280-acb2-c4b9ce861c32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:04.520482 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e6e96b5-77ee-4280-acb2-c4b9ce861c32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:04.520915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0e6e96b5-77ee-4280-acb2-c4b9ce861c32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:04.548508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0e6e96b5-77ee-4280-acb2-c4b9ce861c32 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040521 Apr 07 17:29:04.549578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 485/980] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:05.279198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:05.279802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:05.286822 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:05.287272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:05.288030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:05.288468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:05.347545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:05.355077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5b1ccbb2-a7f0-4ca0-a743-38c84ad6dd67 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079742 Apr 07 17:29:05.355638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 496/981] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:05 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:05.559786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8e2f984d-23a3-4512-a672-64b747d1273d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:05.560715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8e2f984d-23a3-4512-a672-64b747d1273d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:05.567867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e2f984d-23a3-4512-a672-64b747d1273d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:05.568312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e2f984d-23a3-4512-a672-64b747d1273d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:05.569071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e2f984d-23a3-4512-a672-64b747d1273d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:05.569543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e2f984d-23a3-4512-a672-64b747d1273d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:05.598104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8e2f984d-23a3-4512-a672-64b747d1273d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042120 Apr 07 17:29:05.598662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 486/982] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:06.371853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:06.372461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:06.379673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:06.380123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:06.380889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:06.381374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:06.445125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:06.452413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c93b7d81-6173-4fe9-b6fe-6841de634f3e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084457 Apr 07 17:29:06.452964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 497/983] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:06 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:06.609561 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-06e75140-9fac-47ec-879c-7f07307b7c0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:06.610485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-06e75140-9fac-47ec-879c-7f07307b7c0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:06.617366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e75140-9fac-47ec-879c-7f07307b7c0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:06.617820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e75140-9fac-47ec-879c-7f07307b7c0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:06.618583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e75140-9fac-47ec-879c-7f07307b7c0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:06.619019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e75140-9fac-47ec-879c-7f07307b7c0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:06.648045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-06e75140-9fac-47ec-879c-7f07307b7c0e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042373 Apr 07 17:29:06.648785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 487/984] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:07.469712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:07.470308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:07.477367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:07.477819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:07.478573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:07.479006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:07.537133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:07.544370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b302f9ea-edeb-4ab9-b297-6adfb3154677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078562 Apr 07 17:29:07.544923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 498/985] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:07.660508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8777b792-e461-44d4-89d7-f7ec6e7f5871 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:07.661456 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8777b792-e461-44d4-89d7-f7ec6e7f5871 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:07.667639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8777b792-e461-44d4-89d7-f7ec6e7f5871 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:07.668081 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8777b792-e461-44d4-89d7-f7ec6e7f5871 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:07.668830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8777b792-e461-44d4-89d7-f7ec6e7f5871 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:07.669294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8777b792-e461-44d4-89d7-f7ec6e7f5871 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:07.697519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8777b792-e461-44d4-89d7-f7ec6e7f5871 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042045 Apr 07 17:29:07.698059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 488/986] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:08.560884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:08.561552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:08.568494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:08.568944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:08.569735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:08.570174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:08.629907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:08.637282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-29fb40fe-7475-48f8-aee4-8abb556f8194 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080209 Apr 07 17:29:08.637844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 499/987] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:08.709764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4ba2aa26-dd35-4d93-a113-c9e0b68c18df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:08.710709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4ba2aa26-dd35-4d93-a113-c9e0b68c18df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:08.716930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba2aa26-dd35-4d93-a113-c9e0b68c18df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:08.717408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba2aa26-dd35-4d93-a113-c9e0b68c18df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:08.718172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba2aa26-dd35-4d93-a113-c9e0b68c18df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:08.718611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba2aa26-dd35-4d93-a113-c9e0b68c18df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:08.746580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4ba2aa26-dd35-4d93-a113-c9e0b68c18df tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Apr 07 17:29:08.747119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 489/988] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:09.654886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:09.655502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:09.661819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:09.662269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:09.663038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:09.663475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:09.722346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:09.729543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fb66048e-dd3a-428c-bf87-fb3a24526a18 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078474 Apr 07 17:29:09.730102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 500/989] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:09 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:09.758506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2e8fd29d-e08d-4ed0-a832-ce58793fdaf7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:09.759480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2e8fd29d-e08d-4ed0-a832-ce58793fdaf7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:09.765719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e8fd29d-e08d-4ed0-a832-ce58793fdaf7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:09.766165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e8fd29d-e08d-4ed0-a832-ce58793fdaf7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:09.766933 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e8fd29d-e08d-4ed0-a832-ce58793fdaf7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:09.767367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e8fd29d-e08d-4ed0-a832-ce58793fdaf7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:09.794899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2e8fd29d-e08d-4ed0-a832-ce58793fdaf7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040267 Apr 07 17:29:09.795435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 490/990] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:10.753281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:10.753894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:10.760326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:10.760780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:10.761595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:10.762035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:10.807445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f72a8461-e861-4a59-8bb1-8266b1378042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:10.808468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f72a8461-e861-4a59-8bb1-8266b1378042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:10.815022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f72a8461-e861-4a59-8bb1-8266b1378042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:10.815646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f72a8461-e861-4a59-8bb1-8266b1378042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:10.816512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f72a8461-e861-4a59-8bb1-8266b1378042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:10.816953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f72a8461-e861-4a59-8bb1-8266b1378042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:10.823727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:10.831039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4b92b8ac-104d-420c-b0a2-f02157f08e02 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081549 Apr 07 17:29:10.832186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 501/991] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:10.845169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f72a8461-e861-4a59-8bb1-8266b1378042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041573 Apr 07 17:29:10.845702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 491/992] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:29:11.848372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:11.848986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:11.855743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:11.856195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:11.856967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:11.857437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:11.857579 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a78097b8-1ce3-4281-a11c-99c98ff7146b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:11.858343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a78097b8-1ce3-4281-a11c-99c98ff7146b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:11.865339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a78097b8-1ce3-4281-a11c-99c98ff7146b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:11.865785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a78097b8-1ce3-4281-a11c-99c98ff7146b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:11.866542 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a78097b8-1ce3-4281-a11c-99c98ff7146b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:11.866968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a78097b8-1ce3-4281-a11c-99c98ff7146b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:11.895543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a78097b8-1ce3-4281-a11c-99c98ff7146b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042018 Apr 07 17:29:11.896120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 492/993] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:29:11.917558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:11.925497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b7f3a65a-4a07-4f76-a7be-970ff8a06883 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080583 Apr 07 17:29:11.926068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 502/994] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:12.907474 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-41ce4aa8-6568-4ec4-a178-4ab0f639e3b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:12.908301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-41ce4aa8-6568-4ec4-a178-4ab0f639e3b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:12.915080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-41ce4aa8-6568-4ec4-a178-4ab0f639e3b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:12.915524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-41ce4aa8-6568-4ec4-a178-4ab0f639e3b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:12.916275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-41ce4aa8-6568-4ec4-a178-4ab0f639e3b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:12.916702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-41ce4aa8-6568-4ec4-a178-4ab0f639e3b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:12.943124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:12.943890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:12.946303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-41ce4aa8-6568-4ec4-a178-4ab0f639e3b5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042815 Apr 07 17:29:12.946998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 493/995] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:12.950436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:12.950885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:12.951658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:12.952122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:13.226154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:13.233534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-49146ce8-bde5-49d7-9735-4fe95c9a8b99 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.294978 Apr 07 17:29:13.234093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 503/996] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:29:13.958238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ace92e0-26a6-424a-80ee-2c2d3f1293f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:13.959192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ace92e0-26a6-424a-80ee-2c2d3f1293f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:13.965524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ace92e0-26a6-424a-80ee-2c2d3f1293f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:13.965971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ace92e0-26a6-424a-80ee-2c2d3f1293f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:13.966721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ace92e0-26a6-424a-80ee-2c2d3f1293f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:13.967158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ace92e0-26a6-424a-80ee-2c2d3f1293f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:13.997523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ace92e0-26a6-424a-80ee-2c2d3f1293f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Apr 07 17:29:13.998071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 494/997] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:14.250885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:14.251408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:14.258750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:14.259195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:14.259951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:14.260388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:14.320817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:14.328022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6cb4f0c5-d351-4957-b29b-ad32cff59412 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081088 Apr 07 17:29:14.328576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 504/998] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:15.009671 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-68723b22-b439-44e4-97c1-4bc0c30e6b0b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:15.010587 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-68723b22-b439-44e4-97c1-4bc0c30e6b0b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:15.016733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68723b22-b439-44e4-97c1-4bc0c30e6b0b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:15.017208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68723b22-b439-44e4-97c1-4bc0c30e6b0b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:15.017965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68723b22-b439-44e4-97c1-4bc0c30e6b0b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:15.018916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68723b22-b439-44e4-97c1-4bc0c30e6b0b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:15.047394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-68723b22-b439-44e4-97c1-4bc0c30e6b0b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041668 Apr 07 17:29:15.047937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 495/999] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:15.345178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:15.345783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:15.353462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:15.353908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:15.354676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:15.355110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:15.414759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:15.422010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aa6c3647-9bc4-4540-8921-b1de247852d5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080764 Apr 07 17:29:15.422564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 505/1000] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:15 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:16.059678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9d2f5bef-9a05-4d03-810c-7f28fc60949c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:16.060644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9d2f5bef-9a05-4d03-810c-7f28fc60949c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:16.067100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d2f5bef-9a05-4d03-810c-7f28fc60949c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:16.067567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d2f5bef-9a05-4d03-810c-7f28fc60949c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:16.068334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d2f5bef-9a05-4d03-810c-7f28fc60949c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:16.068770 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d2f5bef-9a05-4d03-810c-7f28fc60949c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:16.096232 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9d2f5bef-9a05-4d03-810c-7f28fc60949c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040461 Apr 07 17:29:16.096769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 496/1001] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:16.439714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:16.440352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:16.447278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:16.447713 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:16.448478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:16.448911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:16.507049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:16.514203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-38658ce3-23a3-4a79-a997-0caa6078c675 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078364 Apr 07 17:29:16.514761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 506/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:17.107704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1c12528b-8405-4843-b2f1-fdf862e03960 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:17.108620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1c12528b-8405-4843-b2f1-fdf862e03960 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:17.115374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c12528b-8405-4843-b2f1-fdf862e03960 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:17.115820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c12528b-8405-4843-b2f1-fdf862e03960 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:17.116575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c12528b-8405-4843-b2f1-fdf862e03960 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:17.117008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c12528b-8405-4843-b2f1-fdf862e03960 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:17.144238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1c12528b-8405-4843-b2f1-fdf862e03960 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040493 Apr 07 17:29:17.145563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 497/1003] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:17.531226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:17.531827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:17.538344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:17.538789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:17.539570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:17.540004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:17.600242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:17.607603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c0a5a9bf-002f-436a-8175-106ec3e0ccca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080282 Apr 07 17:29:17.608162 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 507/1004] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:18.156005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-555a89d7-2a32-4dfb-8f33-9ca151362e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:18.156970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-555a89d7-2a32-4dfb-8f33-9ca151362e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:18.163295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-555a89d7-2a32-4dfb-8f33-9ca151362e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:18.163743 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-555a89d7-2a32-4dfb-8f33-9ca151362e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:18.164504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-555a89d7-2a32-4dfb-8f33-9ca151362e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:18.164971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-555a89d7-2a32-4dfb-8f33-9ca151362e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:18.194565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-555a89d7-2a32-4dfb-8f33-9ca151362e7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042535 Apr 07 17:29:18.195110 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 498/1005] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:18.623922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:18.624538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:18.631201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:18.631660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:18.632465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:18.632908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:18.694743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:18.702116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d769b7da-0c50-4128-9182-d02288b8c2ff tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082225 Apr 07 17:29:18.702671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 508/1006] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:18 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:19.206064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-739aa530-fe7a-4325-bd50-54f730a863ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:19.207639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-739aa530-fe7a-4325-bd50-54f730a863ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:19.213922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-739aa530-fe7a-4325-bd50-54f730a863ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:19.214369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-739aa530-fe7a-4325-bd50-54f730a863ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:19.215128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-739aa530-fe7a-4325-bd50-54f730a863ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:19.215562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-739aa530-fe7a-4325-bd50-54f730a863ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:19.242625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-739aa530-fe7a-4325-bd50-54f730a863ec tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040438 Apr 07 17:29:19.243168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 499/1007] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:19.719594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:19.720196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:19.726546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:19.726993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:19.727749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:19.728183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:19.786377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:19.793658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f4839dcf-bb67-4b0c-bc25-e6a694ec4466 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077902 Apr 07 17:29:19.794219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 509/1008] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:20.254312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-884a67e4-b353-449a-8ef3-c427009ede37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:20.255239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-884a67e4-b353-449a-8ef3-c427009ede37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:20.261464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-884a67e4-b353-449a-8ef3-c427009ede37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:20.261909 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-884a67e4-b353-449a-8ef3-c427009ede37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:20.262656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-884a67e4-b353-449a-8ef3-c427009ede37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:20.263088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-884a67e4-b353-449a-8ef3-c427009ede37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:20.291666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-884a67e4-b353-449a-8ef3-c427009ede37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041448 Apr 07 17:29:20.292210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 500/1009] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:20.810289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:20.810898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:20.817465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:20.817919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:20.818684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:20.819120 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:20.879190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:20.886612 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-10930dd8-2e42-499a-ae70-fe6d3a3d4a96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080177 Apr 07 17:29:20.887176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 510/1010] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:21.303811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-872d75c3-1a02-43d9-9def-590a10879e95 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:21.304720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-872d75c3-1a02-43d9-9def-590a10879e95 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:21.310943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-872d75c3-1a02-43d9-9def-590a10879e95 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:21.311388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-872d75c3-1a02-43d9-9def-590a10879e95 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:21.312137 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-872d75c3-1a02-43d9-9def-590a10879e95 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:21.312566 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-872d75c3-1a02-43d9-9def-590a10879e95 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:21.340106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-872d75c3-1a02-43d9-9def-590a10879e95 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040810 Apr 07 17:29:21.340663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 501/1011] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:21.904094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:21.904609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:21.911784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:21.912228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:21.912997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:21.913464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:21.971684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:21.979142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c0cd47cf-de15-41c2-9764-4738d09f7e7a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079008 Apr 07 17:29:21.979707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 511/1012] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:21 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:22.352592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-52b3edea-1fab-4581-8cff-225e30ac69c5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:22.353576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-52b3edea-1fab-4581-8cff-225e30ac69c5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:22.359747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52b3edea-1fab-4581-8cff-225e30ac69c5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:22.360191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52b3edea-1fab-4581-8cff-225e30ac69c5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:22.360945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52b3edea-1fab-4581-8cff-225e30ac69c5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:22.361408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52b3edea-1fab-4581-8cff-225e30ac69c5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:22.546662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-52b3edea-1fab-4581-8cff-225e30ac69c5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197962 Apr 07 17:29:22.547209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 502/1013] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:22.995682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:22.996293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:23.002573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:23.003020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:23.003784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:23.004230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:23.064321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:23.071891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e949d3c4-1ec3-4977-b09f-5b1cadf2ddcd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080060 Apr 07 17:29:23.072456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 512/1014] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:23.557984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0accee6b-39e5-4a83-8830-6fada2919472 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:23.558918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0accee6b-39e5-4a83-8830-6fada2919472 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:23.565087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0accee6b-39e5-4a83-8830-6fada2919472 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:23.565553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0accee6b-39e5-4a83-8830-6fada2919472 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:23.566882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0accee6b-39e5-4a83-8830-6fada2919472 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:23.567322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0accee6b-39e5-4a83-8830-6fada2919472 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:23.595863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0accee6b-39e5-4a83-8830-6fada2919472 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041808 Apr 07 17:29:23.596528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 503/1015] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:24.088036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:24.088630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:24.096238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:24.096851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:24.098040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:24.098652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:24.165079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:24.172403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-29afe406-7e05-4b6d-acba-5fd323b7bb09 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.088224 Apr 07 17:29:24.172964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 513/1016] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:24.608075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b8660f44-4a66-4b98-bef9-412c2b4e258a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:24.608983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b8660f44-4a66-4b98-bef9-412c2b4e258a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:24.615230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8660f44-4a66-4b98-bef9-412c2b4e258a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:24.615666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8660f44-4a66-4b98-bef9-412c2b4e258a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:24.616417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8660f44-4a66-4b98-bef9-412c2b4e258a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:24.616845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8660f44-4a66-4b98-bef9-412c2b4e258a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:24.644077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b8660f44-4a66-4b98-bef9-412c2b4e258a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040329 Apr 07 17:29:24.645234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 504/1017] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:25.189593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:25.190121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:25.197434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:25.197878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:25.198632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:25.199063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:25.258519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:25.265740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-64ca3916-0107-4e24-bbb9-cc9d094ecf04 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080060 Apr 07 17:29:25.266297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 514/1018] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:25.655948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2fbf8308-95f3-45e9-92c6-2127685e4df5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:25.656875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2fbf8308-95f3-45e9-92c6-2127685e4df5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:25.664204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fbf8308-95f3-45e9-92c6-2127685e4df5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:25.664651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fbf8308-95f3-45e9-92c6-2127685e4df5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:25.665442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fbf8308-95f3-45e9-92c6-2127685e4df5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:25.665874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fbf8308-95f3-45e9-92c6-2127685e4df5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:25.694064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2fbf8308-95f3-45e9-92c6-2127685e4df5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041998 Apr 07 17:29:25.694604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 505/1019] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:26.283817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:26.284469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:26.290862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:26.291342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:26.292098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:26.292528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:26.351463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:26.358709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c994448f-0039-4b5c-a4d4-c4bebc374d44 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078808 Apr 07 17:29:26.359277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 515/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:26.705477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dcfb559e-f7da-43d3-b12e-7d66252b9fdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:26.706541 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dcfb559e-f7da-43d3-b12e-7d66252b9fdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:26.712835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcfb559e-f7da-43d3-b12e-7d66252b9fdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:26.713326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcfb559e-f7da-43d3-b12e-7d66252b9fdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:26.714095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcfb559e-f7da-43d3-b12e-7d66252b9fdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:26.714532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcfb559e-f7da-43d3-b12e-7d66252b9fdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:26.744613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dcfb559e-f7da-43d3-b12e-7d66252b9fdf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043011 Apr 07 17:29:26.745168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 506/1021] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:27.377484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:27.378083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:27.385400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:27.385850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:27.386628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:27.387071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:27.447198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:27.454544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9473ff71-1bb9-4f6a-852f-d0ed63e06bd6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081125 Apr 07 17:29:27.455106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 516/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:27 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:27.756874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ea49f458-62f9-48c5-ae4d-2e07b095c34f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:27.757850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ea49f458-62f9-48c5-ae4d-2e07b095c34f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:27.764139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea49f458-62f9-48c5-ae4d-2e07b095c34f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:27.764593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea49f458-62f9-48c5-ae4d-2e07b095c34f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:27.765392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea49f458-62f9-48c5-ae4d-2e07b095c34f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:27.765837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea49f458-62f9-48c5-ae4d-2e07b095c34f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:27.793437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ea49f458-62f9-48c5-ae4d-2e07b095c34f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041122 Apr 07 17:29:27.794002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 507/1023] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:28.472015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:28.473322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:28.479648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:28.480100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:28.480854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:28.481328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:28.540859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:28.548121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9a96a2b9-c4a5-4ebc-841d-c83e99732bd1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079990 Apr 07 17:29:28.548679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 517/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:28.805092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-119ea18f-0a98-43ce-93d6-602e8de516b6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:28.805962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-119ea18f-0a98-43ce-93d6-602e8de516b6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:28.812245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119ea18f-0a98-43ce-93d6-602e8de516b6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:28.812696 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119ea18f-0a98-43ce-93d6-602e8de516b6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:28.813490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119ea18f-0a98-43ce-93d6-602e8de516b6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:28.813927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119ea18f-0a98-43ce-93d6-602e8de516b6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:28.843747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-119ea18f-0a98-43ce-93d6-602e8de516b6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042704 Apr 07 17:29:28.844293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 508/1025] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:29.564597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:29.565230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:29.572046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:29.572477 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:29.573274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:29.573707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:29.633350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:29.640635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9ccf33cc-2723-42b8-bc7b-1a16f6b6575b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079928 Apr 07 17:29:29.641222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 518/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:29 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:29.855356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-93e1c9da-4917-4f81-adbf-1a2bef81e2bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:29.856190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-93e1c9da-4917-4f81-adbf-1a2bef81e2bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:29.862423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-93e1c9da-4917-4f81-adbf-1a2bef81e2bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:29.863254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-93e1c9da-4917-4f81-adbf-1a2bef81e2bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:29.864018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-93e1c9da-4917-4f81-adbf-1a2bef81e2bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:29.864447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-93e1c9da-4917-4f81-adbf-1a2bef81e2bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:29.891718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-93e1c9da-4917-4f81-adbf-1a2bef81e2bb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040410 Apr 07 17:29:29.892247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 509/1027] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:30.657680 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:30.658287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:30.665197 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:30.665643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:30.666406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:30.666836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:30.728614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:30.736255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0f2d345d-c68f-43e6-bb5c-42c1896a30f2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082424 Apr 07 17:29:30.736824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 519/1028] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:30.904278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b79e955d-0d3b-4d39-accf-865ef16c0d97 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:30.905163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b79e955d-0d3b-4d39-accf-865ef16c0d97 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:30.911578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b79e955d-0d3b-4d39-accf-865ef16c0d97 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:30.912023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b79e955d-0d3b-4d39-accf-865ef16c0d97 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:30.912779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b79e955d-0d3b-4d39-accf-865ef16c0d97 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:30.913242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b79e955d-0d3b-4d39-accf-865ef16c0d97 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:30.942067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b79e955d-0d3b-4d39-accf-865ef16c0d97 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041716 Apr 07 17:29:30.942601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 510/1029] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:31.754260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:31.754897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:31.760850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:31.761337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:31.762099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:31.762533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:31.820674 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:31.827957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dce8bc91-69b9-4199-83fb-17d948155d2b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077764 Apr 07 17:29:31.828520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 520/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:31.953371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c0e0e8f5-0d79-4311-a922-b0bf5da900e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:31.954304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c0e0e8f5-0d79-4311-a922-b0bf5da900e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:31.960513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e0e8f5-0d79-4311-a922-b0bf5da900e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:31.960962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e0e8f5-0d79-4311-a922-b0bf5da900e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:31.961759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e0e8f5-0d79-4311-a922-b0bf5da900e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:31.962192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e0e8f5-0d79-4311-a922-b0bf5da900e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:31.990297 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c0e0e8f5-0d79-4311-a922-b0bf5da900e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040844 Apr 07 17:29:31.990835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 511/1031] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:32.844478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:32.845038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:32.852104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:32.852558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:32.853362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:32.853805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:32.912788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:32.920056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cbfc72a2-3a2e-4b70-b2a4-260942b34513 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079507 Apr 07 17:29:32.920779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 521/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:32 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:33.001710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1a2ac223-e2b6-4a58-9a72-c26bf5bb19cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:33.002626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1a2ac223-e2b6-4a58-9a72-c26bf5bb19cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:33.008824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2ac223-e2b6-4a58-9a72-c26bf5bb19cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:33.009306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2ac223-e2b6-4a58-9a72-c26bf5bb19cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:33.010071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2ac223-e2b6-4a58-9a72-c26bf5bb19cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:33.010511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2ac223-e2b6-4a58-9a72-c26bf5bb19cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:33.039885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1a2ac223-e2b6-4a58-9a72-c26bf5bb19cd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Apr 07 17:29:33.040426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 512/1033] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:33.935734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:33.936344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:33.943616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:33.944057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:33.944831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:33.945281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:34.005230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:34.012413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-abd21140-9285-41ed-a697-0e2788daba8c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080480 Apr 07 17:29:34.012975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 522/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:34.051310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3c24e18e-5dbe-46ef-8831-ab9b30e9659e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:34.052225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3c24e18e-5dbe-46ef-8831-ab9b30e9659e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:34.058437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c24e18e-5dbe-46ef-8831-ab9b30e9659e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:34.058889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c24e18e-5dbe-46ef-8831-ab9b30e9659e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:34.059648 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c24e18e-5dbe-46ef-8831-ab9b30e9659e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:34.060093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c24e18e-5dbe-46ef-8831-ab9b30e9659e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:34.089058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3c24e18e-5dbe-46ef-8831-ab9b30e9659e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041712 Apr 07 17:29:34.089626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 513/1035] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:35.030275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:35.030878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:35.037804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:35.038247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:35.039005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:35.039436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:35.098852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:35.100497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7065d242-c726-4728-b586-cbfe404f56a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:35.101510 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7065d242-c726-4728-b586-cbfe404f56a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:35.106292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-be839b08-d516-4ff8-bfc1-bbb8e1aa6b30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079934 Apr 07 17:29:35.106860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 523/1036] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:35.107839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7065d242-c726-4728-b586-cbfe404f56a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:35.108307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7065d242-c726-4728-b586-cbfe404f56a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:35.109089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7065d242-c726-4728-b586-cbfe404f56a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:35.109552 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7065d242-c726-4728-b586-cbfe404f56a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:35.137354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7065d242-c726-4728-b586-cbfe404f56a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041335 Apr 07 17:29:35.137894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 514/1037] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:29:36.122979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:36.123583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:36.129927 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:36.130373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:36.131136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:36.131573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:36.149648 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-03f9bf97-80c9-4f0d-a0d8-34be8e70384a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:36.150742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-03f9bf97-80c9-4f0d-a0d8-34be8e70384a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:36.157015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03f9bf97-80c9-4f0d-a0d8-34be8e70384a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:36.157507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03f9bf97-80c9-4f0d-a0d8-34be8e70384a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:36.158392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03f9bf97-80c9-4f0d-a0d8-34be8e70384a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:36.158836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-03f9bf97-80c9-4f0d-a0d8-34be8e70384a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:36.188036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-03f9bf97-80c9-4f0d-a0d8-34be8e70384a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 Apr 07 17:29:36.188500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 515/1038] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:29:36.197249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:36.204868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e832a11d-114c-4775-bd1c-95dd0481ef74 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085737 Apr 07 17:29:36.205467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 524/1039] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:37.200399 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-236a9b21-6319-44a5-985b-a9f188e0fc33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:37.201303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-236a9b21-6319-44a5-985b-a9f188e0fc33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:37.208587 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-236a9b21-6319-44a5-985b-a9f188e0fc33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:37.209047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-236a9b21-6319-44a5-985b-a9f188e0fc33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:37.209847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-236a9b21-6319-44a5-985b-a9f188e0fc33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:37.210281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-236a9b21-6319-44a5-985b-a9f188e0fc33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:37.221819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:37.222491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:37.228745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:37.229213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:37.229979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:37.230410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:37.238333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-236a9b21-6319-44a5-985b-a9f188e0fc33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041912 Apr 07 17:29:37.238885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 516/1040] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:37.292683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:37.300470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fdc10b6c-3af0-4c65-ba00-03a25bb44a00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081988 Apr 07 17:29:37.301038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 525/1041] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:29:38.249947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-307998f2-7c2f-454a-9691-cdbe6fc7c46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:38.250865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-307998f2-7c2f-454a-9691-cdbe6fc7c46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:38.257128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-307998f2-7c2f-454a-9691-cdbe6fc7c46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:38.257604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-307998f2-7c2f-454a-9691-cdbe6fc7c46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:38.258367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-307998f2-7c2f-454a-9691-cdbe6fc7c46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:38.258801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-307998f2-7c2f-454a-9691-cdbe6fc7c46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:38.287473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-307998f2-7c2f-454a-9691-cdbe6fc7c46b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041489 Apr 07 17:29:38.288007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 517/1042] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:38.317440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:38.318078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:38.324394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:38.324852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:38.325648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:38.326089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:38.384486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:38.391711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e775b18e-2b8a-43d5-9204-bb8f3eea3133 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078469 Apr 07 17:29:38.392279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 526/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:39.298707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-abccd3d1-843c-40eb-a99f-905d6b13bcb7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:39.299625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-abccd3d1-843c-40eb-a99f-905d6b13bcb7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:39.306101 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abccd3d1-843c-40eb-a99f-905d6b13bcb7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:39.306605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abccd3d1-843c-40eb-a99f-905d6b13bcb7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:39.307371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abccd3d1-843c-40eb-a99f-905d6b13bcb7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:39.307807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abccd3d1-843c-40eb-a99f-905d6b13bcb7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:39.336762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-abccd3d1-843c-40eb-a99f-905d6b13bcb7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041905 Apr 07 17:29:39.337346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 518/1044] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:39.409278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:39.409936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:39.416273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:39.416715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:39.417502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:39.417936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:39.476925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:39.484231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b4deb841-594b-439e-986a-341b5e892d31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078902 Apr 07 17:29:39.484785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 527/1045] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:40.348490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-286a473c-d3f5-479e-8f4c-d49e918baaa5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:40.349441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-286a473c-d3f5-479e-8f4c-d49e918baaa5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:40.355886 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-286a473c-d3f5-479e-8f4c-d49e918baaa5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:40.356331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-286a473c-d3f5-479e-8f4c-d49e918baaa5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:40.357093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-286a473c-d3f5-479e-8f4c-d49e918baaa5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:40.357557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-286a473c-d3f5-479e-8f4c-d49e918baaa5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:40.386652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-286a473c-d3f5-479e-8f4c-d49e918baaa5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042307 Apr 07 17:29:40.387195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 519/1046] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:40.501497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:40.502113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:40.509226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:40.509685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:40.510456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:40.510895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:40.569624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:40.577059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f07d773f-08e3-42fe-8b4a-3f3d5f998896 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079432 Apr 07 17:29:40.577654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 528/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:41.399210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-89ef9389-569f-40a5-9897-d8474de417d6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:41.400048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-89ef9389-569f-40a5-9897-d8474de417d6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:41.406365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89ef9389-569f-40a5-9897-d8474de417d6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:41.406815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89ef9389-569f-40a5-9897-d8474de417d6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:41.407574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89ef9389-569f-40a5-9897-d8474de417d6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:41.408013 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89ef9389-569f-40a5-9897-d8474de417d6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:41.436650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-89ef9389-569f-40a5-9897-d8474de417d6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041801 Apr 07 17:29:41.437207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 520/1048] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:41.593753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:41.594363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:41.600716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:41.601191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:41.601962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:41.602401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:41.661685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:41.668991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-63a72b25-1994-468d-94d5-908efa959c3f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079079 Apr 07 17:29:41.669583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 529/1049] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:42.448139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-47262447-d465-4c9f-82bb-eff7342cf563 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:42.449061 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-47262447-d465-4c9f-82bb-eff7342cf563 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:42.455344 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47262447-d465-4c9f-82bb-eff7342cf563 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:42.455798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47262447-d465-4c9f-82bb-eff7342cf563 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:42.456601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47262447-d465-4c9f-82bb-eff7342cf563 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:42.457069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47262447-d465-4c9f-82bb-eff7342cf563 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:42.485448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-47262447-d465-4c9f-82bb-eff7342cf563 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041179 Apr 07 17:29:42.486002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 521/1050] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:42.687518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:42.688134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:42.694518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:42.694976 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:42.695749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:42.696189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:42.756783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:42.764138 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dd63079a-48e3-4deb-a4b8-f4d3bb845d00 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080476 Apr 07 17:29:42.764705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 530/1051] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:42 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:43.497877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-19f84ecc-c8df-4523-ac33-4845f7b60721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:43.498792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-19f84ecc-c8df-4523-ac33-4845f7b60721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:43.506096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f84ecc-c8df-4523-ac33-4845f7b60721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:43.506545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f84ecc-c8df-4523-ac33-4845f7b60721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:43.507303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f84ecc-c8df-4523-ac33-4845f7b60721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:43.507730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19f84ecc-c8df-4523-ac33-4845f7b60721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:43.536814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-19f84ecc-c8df-4523-ac33-4845f7b60721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 Apr 07 17:29:43.537393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 522/1052] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:43.781543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:43.782056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:43.789391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:43.789839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:43.790594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:43.791027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:43.851512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:43.858760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2b080f6f-df77-407c-9c9e-b310028db3e9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081194 Apr 07 17:29:43.859522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 531/1053] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:43 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:29:44.548629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cff827a2-f35b-4f70-82b4-a42314acf78f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:44.549562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cff827a2-f35b-4f70-82b4-a42314acf78f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:44.556239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cff827a2-f35b-4f70-82b4-a42314acf78f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:44.556708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cff827a2-f35b-4f70-82b4-a42314acf78f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:44.557483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cff827a2-f35b-4f70-82b4-a42314acf78f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:44.557915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cff827a2-f35b-4f70-82b4-a42314acf78f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:44.587025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cff827a2-f35b-4f70-82b4-a42314acf78f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042322 Apr 07 17:29:44.587563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 523/1054] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:44.876057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:44.876595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:44.883652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:44.884107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:44.884872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:44.885347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:44.946162 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:44.952854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8966f6b3-0e6a-4e56-b6ed-500ef4904366 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080863 Apr 07 17:29:44.953470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 532/1055] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:44 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:45.600661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-247a36ad-1cf5-4c02-b989-e7052ee8eb2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:45.601606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-247a36ad-1cf5-4c02-b989-e7052ee8eb2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:45.609360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-247a36ad-1cf5-4c02-b989-e7052ee8eb2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:45.609808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-247a36ad-1cf5-4c02-b989-e7052ee8eb2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:45.610567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-247a36ad-1cf5-4c02-b989-e7052ee8eb2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:45.611002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-247a36ad-1cf5-4c02-b989-e7052ee8eb2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:45.639314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-247a36ad-1cf5-4c02-b989-e7052ee8eb2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Apr 07 17:29:45.639858 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 524/1056] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:45.969714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:45.970318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:45.976698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:45.977165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:45.977924 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:45.978363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:46.036699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:46.043895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6511ca91-2190-4f1a-8c1d-b85e28c84a42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078101 Apr 07 17:29:46.044454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 533/1057] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:46.652125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fefcf5e0-ce49-4898-9659-f9d6cbdf40e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:46.653055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fefcf5e0-ce49-4898-9659-f9d6cbdf40e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:46.659335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fefcf5e0-ce49-4898-9659-f9d6cbdf40e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:46.659788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fefcf5e0-ce49-4898-9659-f9d6cbdf40e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:46.660554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fefcf5e0-ce49-4898-9659-f9d6cbdf40e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:46.661132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fefcf5e0-ce49-4898-9659-f9d6cbdf40e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:46.689160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fefcf5e0-ce49-4898-9659-f9d6cbdf40e6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041208 Apr 07 17:29:46.689711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 525/1058] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:29:47.059711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:47.060321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:47.066695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:47.067938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:47.068800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:47.069269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:47.128212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:47.136190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-004a996d-d786-4921-9124-83e22f5e5926 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080375 Apr 07 17:29:47.136749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 534/1059] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:47.701262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4cebe6e4-e87c-483d-aa89-19e84e444602 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:47.702182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4cebe6e4-e87c-483d-aa89-19e84e444602 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:47.708351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4cebe6e4-e87c-483d-aa89-19e84e444602 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:47.708795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4cebe6e4-e87c-483d-aa89-19e84e444602 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:47.709581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4cebe6e4-e87c-483d-aa89-19e84e444602 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:47.710019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4cebe6e4-e87c-483d-aa89-19e84e444602 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:47.737596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4cebe6e4-e87c-483d-aa89-19e84e444602 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040281 Apr 07 17:29:47.738133 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 526/1060] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:48.152815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:48.153445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:48.159723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:48.160167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:48.161401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:48.161844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:48.220792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:48.228638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2d1f6453-cc0e-48c4-8558-5d3c62b0f3e5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079938 Apr 07 17:29:48.229223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 535/1061] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:48.749827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-10aa9b16-fa5a-467f-9070-f16aadfce888 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:48.750746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-10aa9b16-fa5a-467f-9070-f16aadfce888 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:48.757306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10aa9b16-fa5a-467f-9070-f16aadfce888 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:48.757760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10aa9b16-fa5a-467f-9070-f16aadfce888 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:48.758533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10aa9b16-fa5a-467f-9070-f16aadfce888 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:48.758977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10aa9b16-fa5a-467f-9070-f16aadfce888 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:48.787913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-10aa9b16-fa5a-467f-9070-f16aadfce888 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042072 Apr 07 17:29:48.788447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 527/1062] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:49.245795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:49.246359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:49.252585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:49.253025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:49.253807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:49.254238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:49.313390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:49.320993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-89157a3f-5e0e-4a5c-b6b5-cc59a7d9ef06 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079201 Apr 07 17:29:49.321586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 536/1063] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:49.799445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-27508b9c-0fa9-401c-a8db-cd01ed9a63c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:49.800361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-27508b9c-0fa9-401c-a8db-cd01ed9a63c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:49.807105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27508b9c-0fa9-401c-a8db-cd01ed9a63c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:49.807549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27508b9c-0fa9-401c-a8db-cd01ed9a63c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:49.808304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27508b9c-0fa9-401c-a8db-cd01ed9a63c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:49.808734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27508b9c-0fa9-401c-a8db-cd01ed9a63c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:49.837746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-27508b9c-0fa9-401c-a8db-cd01ed9a63c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042254 Apr 07 17:29:49.838279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 528/1064] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:50.337473 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:50.338097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:50.344493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:50.344944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:50.345740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:50.346182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:50.409520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:50.417306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7ab949a5-a3f2-4083-98d9-2bdd95b9c91c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083725 Apr 07 17:29:50.417866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 537/1065] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:50 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:50.734989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:29:50.735167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:29:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:29:50.849475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b699a278-1119-4e3c-87a0-abb33295e412 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:50.850415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b699a278-1119-4e3c-87a0-abb33295e412 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:50.856690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b699a278-1119-4e3c-87a0-abb33295e412 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:50.857155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b699a278-1119-4e3c-87a0-abb33295e412 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:50.857928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b699a278-1119-4e3c-87a0-abb33295e412 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:50.858363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b699a278-1119-4e3c-87a0-abb33295e412 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:50.886447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b699a278-1119-4e3c-87a0-abb33295e412 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041399 Apr 07 17:29:50.886983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 529/1066] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:51.434587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:51.435192 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:51.441555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:51.442559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:51.443331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:51.443815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:51.502379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:51.510250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ed203876-71e4-4184-9d54-d2675c91dc64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079548 Apr 07 17:29:51.510812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 538/1067] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:51 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:51.898339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c6777b1f-4cf1-4da3-b34d-07426a163a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:51.899469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c6777b1f-4cf1-4da3-b34d-07426a163a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:51.905760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6777b1f-4cf1-4da3-b34d-07426a163a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:51.906208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6777b1f-4cf1-4da3-b34d-07426a163a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:51.906968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6777b1f-4cf1-4da3-b34d-07426a163a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:51.907404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6777b1f-4cf1-4da3-b34d-07426a163a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:51.936243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c6777b1f-4cf1-4da3-b34d-07426a163a65 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041984 Apr 07 17:29:51.936887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 530/1068] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:52.527644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:52.528256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:52.534592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:52.535042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:52.536964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:52.537431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:52.594772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:52.605445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c3143608-8d7e-46fc-bdfc-fe9a5e5e8c4c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081990 Apr 07 17:29:52.606009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 539/1069] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:52 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:52.948022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2caf9b04-cb64-4b8f-9671-db87bff1d06f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:52.948944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2caf9b04-cb64-4b8f-9671-db87bff1d06f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:52.955245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2caf9b04-cb64-4b8f-9671-db87bff1d06f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:52.955690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2caf9b04-cb64-4b8f-9671-db87bff1d06f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:52.956446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2caf9b04-cb64-4b8f-9671-db87bff1d06f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:52.956880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2caf9b04-cb64-4b8f-9671-db87bff1d06f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:52.985619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2caf9b04-cb64-4b8f-9671-db87bff1d06f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041558 Apr 07 17:29:52.986166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 531/1070] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:53.622011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:53.622626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:53.629017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:53.629849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:53.630604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:53.631051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:53.697495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:53.704847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4daade43-0b44-4213-80b0-24db32eadeca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086836 Apr 07 17:29:53.705517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 540/1071] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:53.997438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9bcd889b-d3f3-4e50-878c-f78379463eaa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:53.998352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9bcd889b-d3f3-4e50-878c-f78379463eaa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:54.005108 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bcd889b-d3f3-4e50-878c-f78379463eaa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:54.005594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bcd889b-d3f3-4e50-878c-f78379463eaa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:54.006351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bcd889b-d3f3-4e50-878c-f78379463eaa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:54.006788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9bcd889b-d3f3-4e50-878c-f78379463eaa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:54.034828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9bcd889b-d3f3-4e50-878c-f78379463eaa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041368 Apr 07 17:29:54.035425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 532/1072] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:54.721684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:54.722297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:54.728856 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:54.729349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:54.730121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:54.730561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:54.790620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:54.797923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7a4193b6-669f-49a3-8165-7d181abd19d1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080200 Apr 07 17:29:54.798485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 541/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:54 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:55.046781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-940e649e-d9bc-4345-868e-dcf35b148d1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:55.047697 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-940e649e-d9bc-4345-868e-dcf35b148d1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:55.054575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-940e649e-d9bc-4345-868e-dcf35b148d1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:55.055057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-940e649e-d9bc-4345-868e-dcf35b148d1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:55.055813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-940e649e-d9bc-4345-868e-dcf35b148d1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:55.056248 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-940e649e-d9bc-4345-868e-dcf35b148d1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:55.083516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-940e649e-d9bc-4345-868e-dcf35b148d1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040669 Apr 07 17:29:55.084057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 533/1074] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:55.815364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:55.815980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:55.823410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:55.823855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:55.824649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:55.825083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:55.884574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:55.891873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-057cd8e2-f09b-4138-aa43-b19504134623 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080456 Apr 07 17:29:55.892432 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 542/1075] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:56.094938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b83178f1-ef92-40c9-8f1c-0ffb1fbd9dee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:56.095844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b83178f1-ef92-40c9-8f1c-0ffb1fbd9dee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:56.102585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b83178f1-ef92-40c9-8f1c-0ffb1fbd9dee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:56.103027 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b83178f1-ef92-40c9-8f1c-0ffb1fbd9dee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:56.103782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b83178f1-ef92-40c9-8f1c-0ffb1fbd9dee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:56.104211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b83178f1-ef92-40c9-8f1c-0ffb1fbd9dee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:56.133305 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b83178f1-ef92-40c9-8f1c-0ffb1fbd9dee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042216 Apr 07 17:29:56.133838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 534/1076] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:56.909617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:56.910224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:56.917124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:56.917608 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:56.918379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:56.919434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:56.984655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:56.992103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1652afef-6d97-425a-9972-3019bdac3f73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086336 Apr 07 17:29:56.992672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 543/1077] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:57.212469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6fcfdd34-1972-4efe-8d8f-2f235b830211 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:57.213445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6fcfdd34-1972-4efe-8d8f-2f235b830211 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:57.219293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fcfdd34-1972-4efe-8d8f-2f235b830211 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:57.219741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fcfdd34-1972-4efe-8d8f-2f235b830211 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:57.220504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fcfdd34-1972-4efe-8d8f-2f235b830211 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:57.220942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fcfdd34-1972-4efe-8d8f-2f235b830211 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:57.249323 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6fcfdd34-1972-4efe-8d8f-2f235b830211 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108982 Apr 07 17:29:57.250071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 535/1078] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:58.009589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:58.010189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:58.016448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:58.016893 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:58.017709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:58.018140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:58.076517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:58.084543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-627cb154-4473-4aaa-85e2-9681836a2bbe tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078644 Apr 07 17:29:58.085099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 544/1079] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:58.260611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-516870c8-80cd-4c36-986c-0bbec07399ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:58.261504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-516870c8-80cd-4c36-986c-0bbec07399ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:58.267788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-516870c8-80cd-4c36-986c-0bbec07399ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:58.268231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-516870c8-80cd-4c36-986c-0bbec07399ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:58.268989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-516870c8-80cd-4c36-986c-0bbec07399ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:58.269448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-516870c8-80cd-4c36-986c-0bbec07399ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:58.299329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-516870c8-80cd-4c36-986c-0bbec07399ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Apr 07 17:29:58.299884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 536/1080] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:29:59.101426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:59.102031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:59.108330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:59.108773 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:59.109560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:59.109995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:59.213548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:29:59.221107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f0643065-ea88-4404-a180-51ee37d241ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.124191 Apr 07 17:29:59.221701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 545/1081] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:29:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:29:59.310897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f8f37708-0486-4b1f-9c38-ee6964f2109a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:29:59.311821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f8f37708-0486-4b1f-9c38-ee6964f2109a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:29:59.318830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f37708-0486-4b1f-9c38-ee6964f2109a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:59.319279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f37708-0486-4b1f-9c38-ee6964f2109a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:59.320041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f37708-0486-4b1f-9c38-ee6964f2109a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:29:59.320509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8f37708-0486-4b1f-9c38-ee6964f2109a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:29:59.347665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f8f37708-0486-4b1f-9c38-ee6964f2109a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040790 Apr 07 17:29:59.348204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 537/1082] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:29:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:00.237991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:00.238731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:00.246364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:00.246815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:00.247579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:00.248018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:00.306689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:00.314327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a2c58aee-13df-42de-a41f-cb9e3f7ab5c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080222 Apr 07 17:30:00.314900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 546/1083] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:00.359140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-831fc50e-4f06-4919-9ba9-a0d288e43090 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:00.360087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-831fc50e-4f06-4919-9ba9-a0d288e43090 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:00.366414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-831fc50e-4f06-4919-9ba9-a0d288e43090 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:00.366869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-831fc50e-4f06-4919-9ba9-a0d288e43090 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:00.367623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-831fc50e-4f06-4919-9ba9-a0d288e43090 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:00.368056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-831fc50e-4f06-4919-9ba9-a0d288e43090 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:00.396126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-831fc50e-4f06-4919-9ba9-a0d288e43090 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040988 Apr 07 17:30:00.396659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 538/1084] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:01.331936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:01.332974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:01.339018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:01.339461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:01.340218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:01.340647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:01.400337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:01.406876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b55116dc-e51e-45f8-b7b9-d0532a77cdaf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:01.407669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-518305f9-690a-436f-ab23-22781e38e456 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079709 Apr 07 17:30:01.407992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b55116dc-e51e-45f8-b7b9-d0532a77cdaf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:01.408989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 547/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:01.414230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b55116dc-e51e-45f8-b7b9-d0532a77cdaf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:01.414676 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b55116dc-e51e-45f8-b7b9-d0532a77cdaf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:01.415437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b55116dc-e51e-45f8-b7b9-d0532a77cdaf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:01.415866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b55116dc-e51e-45f8-b7b9-d0532a77cdaf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:01.444358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b55116dc-e51e-45f8-b7b9-d0532a77cdaf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Apr 07 17:30:01.444897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 539/1086] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:02.424783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:02.425420 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:02.431844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:02.432299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:02.433062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:02.433525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:02.455817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0207b2da-7bfe-40f9-86e3-76124ddab000 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:02.456725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0207b2da-7bfe-40f9-86e3-76124ddab000 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:02.464021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0207b2da-7bfe-40f9-86e3-76124ddab000 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:02.464446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0207b2da-7bfe-40f9-86e3-76124ddab000 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:02.465226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0207b2da-7bfe-40f9-86e3-76124ddab000 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:02.465656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0207b2da-7bfe-40f9-86e3-76124ddab000 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:02.493744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:02.496054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0207b2da-7bfe-40f9-86e3-76124ddab000 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Apr 07 17:30:02.496618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 540/1087] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:02.501425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-94c28a02-705c-46d3-87d6-4951afed9e08 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080436 Apr 07 17:30:02.501986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 548/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:02 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:03.510494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6fa91c7d-f778-4408-b575-21e10f6adf57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:03.510494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6fa91c7d-f778-4408-b575-21e10f6adf57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:03.517456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:03.517970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fa91c7d-f778-4408-b575-21e10f6adf57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:03.518138 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:03.518246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fa91c7d-f778-4408-b575-21e10f6adf57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:03.518934 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fa91c7d-f778-4408-b575-21e10f6adf57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:03.519491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6fa91c7d-f778-4408-b575-21e10f6adf57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:03.525318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:03.525814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:03.526592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:03.527248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:03.549228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6fa91c7d-f778-4408-b575-21e10f6adf57 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045459 Apr 07 17:30:03.549792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 541/1089] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:03.591966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:03.599621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dbbea242-2c02-472e-96bb-f19924978bd9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085947 Apr 07 17:30:03.600195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 549/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:04.561901 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b647bdc4-4eb9-43f0-87dd-b197a0c22405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:04.562812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b647bdc4-4eb9-43f0-87dd-b197a0c22405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:04.569015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b647bdc4-4eb9-43f0-87dd-b197a0c22405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:04.569488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b647bdc4-4eb9-43f0-87dd-b197a0c22405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:04.570240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b647bdc4-4eb9-43f0-87dd-b197a0c22405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:04.570671 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b647bdc4-4eb9-43f0-87dd-b197a0c22405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:04.602083 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b647bdc4-4eb9-43f0-87dd-b197a0c22405 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044024 Apr 07 17:30:04.602638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 542/1091] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:04.616344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:04.616961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:04.623338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:04.623792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:04.624561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:04.625002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:04.686956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:04.695054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0547faaf-b105-42b7-a08e-6195d17aa4c9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082601 Apr 07 17:30:04.695619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 550/1092] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:04 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:05.614407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-600fc1a7-22a6-4647-abc2-f600a0d9e8bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:05.616729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-600fc1a7-22a6-4647-abc2-f600a0d9e8bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:05.621358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-600fc1a7-22a6-4647-abc2-f600a0d9e8bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:05.621808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-600fc1a7-22a6-4647-abc2-f600a0d9e8bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:05.622571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-600fc1a7-22a6-4647-abc2-f600a0d9e8bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:05.623001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-600fc1a7-22a6-4647-abc2-f600a0d9e8bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:05.651241 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-600fc1a7-22a6-4647-abc2-f600a0d9e8bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041602 Apr 07 17:30:05.653395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 543/1093] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:05.711691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:05.712299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:05.718599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:05.719050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:05.719819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:05.720255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:05.779792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:05.787933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5ec0d2e2-4849-4081-9b03-2ac9c06ca118 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080159 Apr 07 17:30:05.788495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 551/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:05 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:06.662982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1e3c7a9d-6e8f-4b26-8be8-00162cda3376 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:06.664964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1e3c7a9d-6e8f-4b26-8be8-00162cda3376 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:06.671449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e3c7a9d-6e8f-4b26-8be8-00162cda3376 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:06.671903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e3c7a9d-6e8f-4b26-8be8-00162cda3376 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:06.672678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e3c7a9d-6e8f-4b26-8be8-00162cda3376 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:06.673117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e3c7a9d-6e8f-4b26-8be8-00162cda3376 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:06.701345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1e3c7a9d-6e8f-4b26-8be8-00162cda3376 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Apr 07 17:30:06.701881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 544/1095] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:06.804497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:06.805155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:06.811386 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:06.811829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:06.812586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:06.813018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:06.871769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:06.879605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-db54a61d-2ff8-4ebc-a733-55f985501a26 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078439 Apr 07 17:30:06.880159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 552/1096] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:06 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:07.712631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8d808dbf-5393-44dc-ace2-6b2ca32b6425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:07.713572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8d808dbf-5393-44dc-ace2-6b2ca32b6425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:07.719836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d808dbf-5393-44dc-ace2-6b2ca32b6425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:07.720280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d808dbf-5393-44dc-ace2-6b2ca32b6425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:07.721041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d808dbf-5393-44dc-ace2-6b2ca32b6425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:07.721499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d808dbf-5393-44dc-ace2-6b2ca32b6425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:07.748461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8d808dbf-5393-44dc-ace2-6b2ca32b6425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.039817 Apr 07 17:30:07.748993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 545/1097] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:07.896708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:07.897343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:07.903956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:07.904350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:07.905107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:07.905568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:07.963830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:07.971082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-39ddfb43-505a-4931-b4ac-0e67da579488 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078910 Apr 07 17:30:07.971646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 553/1098] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:08.760617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-167e4888-847b-4bd6-babb-9c24e202cfcc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:08.761555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-167e4888-847b-4bd6-babb-9c24e202cfcc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:08.767843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-167e4888-847b-4bd6-babb-9c24e202cfcc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:08.768291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-167e4888-847b-4bd6-babb-9c24e202cfcc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:08.769043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-167e4888-847b-4bd6-babb-9c24e202cfcc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:08.770120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-167e4888-847b-4bd6-babb-9c24e202cfcc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:08.797782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-167e4888-847b-4bd6-babb-9c24e202cfcc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041115 Apr 07 17:30:08.798323 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 546/1099] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:08.989314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:08.989933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:08.995983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:09.001411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:09.001411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:09.001411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:09.060635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:09.068825 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7d54c635-4f72-4c9a-896c-43beae606156 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084785 Apr 07 17:30:09.069438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 554/1100] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:09.810158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-94e977f1-ca70-41de-a353-52d0886c468b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:09.811075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-94e977f1-ca70-41de-a353-52d0886c468b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:09.817804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-94e977f1-ca70-41de-a353-52d0886c468b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:09.818251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-94e977f1-ca70-41de-a353-52d0886c468b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:09.819012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-94e977f1-ca70-41de-a353-52d0886c468b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:09.819441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-94e977f1-ca70-41de-a353-52d0886c468b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:09.848209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-94e977f1-ca70-41de-a353-52d0886c468b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041238 Apr 07 17:30:09.848751 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 547/1101] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:10.085943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:10.086562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:10.092958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:10.093443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:10.094217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:10.094659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:10.156622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:10.164119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d05965df-2736-401d-9471-68887a0554a4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082785 Apr 07 17:30:10.164678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 555/1102] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:10.859734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9212a906-7683-45fa-8361-5e8b269ec164 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:10.860681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9212a906-7683-45fa-8361-5e8b269ec164 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:10.868090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9212a906-7683-45fa-8361-5e8b269ec164 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:10.868533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9212a906-7683-45fa-8361-5e8b269ec164 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:10.869318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9212a906-7683-45fa-8361-5e8b269ec164 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:10.869747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9212a906-7683-45fa-8361-5e8b269ec164 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:10.897968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9212a906-7683-45fa-8361-5e8b269ec164 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042121 Apr 07 17:30:10.898788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 548/1103] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:11.180733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:11.181384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:11.187722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:11.188171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:11.188942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:11.189409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:11.248494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:11.256485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-48acc37c-2275-4dbf-994e-faafafe39047 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079692 Apr 07 17:30:11.257041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 556/1104] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:11.910603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-53e0caaa-47df-480f-80d9-114a19c41f33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:11.911350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-53e0caaa-47df-480f-80d9-114a19c41f33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:11.917550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53e0caaa-47df-480f-80d9-114a19c41f33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:11.917992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53e0caaa-47df-480f-80d9-114a19c41f33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:11.918744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53e0caaa-47df-480f-80d9-114a19c41f33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:11.919173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53e0caaa-47df-480f-80d9-114a19c41f33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:11.947875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-53e0caaa-47df-480f-80d9-114a19c41f33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041912 Apr 07 17:30:11.948417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 549/1105] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:12.273645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:12.274263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:12.280232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:12.280681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:12.281470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:12.281910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:12.342602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:12.350483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-671313ed-2520-4dc1-b5c7-80f860bfefd8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081500 Apr 07 17:30:12.351052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 557/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:12.959546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-28f5a48b-eb49-412e-bb55-42ac43b89afb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:12.960468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-28f5a48b-eb49-412e-bb55-42ac43b89afb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:12.966700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28f5a48b-eb49-412e-bb55-42ac43b89afb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:12.967146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28f5a48b-eb49-412e-bb55-42ac43b89afb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:12.967905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28f5a48b-eb49-412e-bb55-42ac43b89afb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:12.968336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28f5a48b-eb49-412e-bb55-42ac43b89afb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:12.997749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-28f5a48b-eb49-412e-bb55-42ac43b89afb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042173 Apr 07 17:30:12.998285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 550/1107] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:13.367636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:13.368172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:13.374426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:13.375002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:13.375765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:13.376199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:13.435215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:13.443033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-155c0e28-0af8-4a1a-abf0-45caabded27d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079787 Apr 07 17:30:13.443602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 558/1108] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:14.009045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ff938694-60df-4574-8a7c-55ae0a59ce8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:14.010091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ff938694-60df-4574-8a7c-55ae0a59ce8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:14.016363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff938694-60df-4574-8a7c-55ae0a59ce8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:14.016812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff938694-60df-4574-8a7c-55ae0a59ce8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:14.017602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff938694-60df-4574-8a7c-55ae0a59ce8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:14.018041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff938694-60df-4574-8a7c-55ae0a59ce8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:14.046556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ff938694-60df-4574-8a7c-55ae0a59ce8e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041433 Apr 07 17:30:14.047106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 551/1109] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:14.459724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:14.460335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:14.466704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:14.467154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:14.467920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:14.468360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:14.541037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:14.548574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4bedc96d-cdd2-4f5a-97fa-46f5d4d7a274 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.092694 Apr 07 17:30:14.549371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 559/1110] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:15.058956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0010d490-a818-4e92-8058-cd75ee131a6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:15.060006 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0010d490-a818-4e92-8058-cd75ee131a6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:15.066730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0010d490-a818-4e92-8058-cd75ee131a6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:15.073225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0010d490-a818-4e92-8058-cd75ee131a6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:15.073225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0010d490-a818-4e92-8058-cd75ee131a6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:15.073225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0010d490-a818-4e92-8058-cd75ee131a6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:15.096381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0010d490-a818-4e92-8058-cd75ee131a6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041371 Apr 07 17:30:15.097271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 552/1111] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:15.566057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:15.566938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:15.573417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:15.573874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:15.574706 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:15.575145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:15.634118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:15.641454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-75ac4967-0a3b-43c3-ab5d-ab236975c6a3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079308 Apr 07 17:30:15.642026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 560/1112] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:15 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:16.108267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a299f5e7-3c8c-4d25-975f-0017eaf511dc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:16.109201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a299f5e7-3c8c-4d25-975f-0017eaf511dc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:16.115505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a299f5e7-3c8c-4d25-975f-0017eaf511dc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:16.115946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a299f5e7-3c8c-4d25-975f-0017eaf511dc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:16.116696 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a299f5e7-3c8c-4d25-975f-0017eaf511dc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:16.117127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a299f5e7-3c8c-4d25-975f-0017eaf511dc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:16.145825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a299f5e7-3c8c-4d25-975f-0017eaf511dc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041642 Apr 07 17:30:16.146412 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 553/1113] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:16.659233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:16.660687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:16.666833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:16.667288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:16.668059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:16.668508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:16.732644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:16.741503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e80f50e0-eabd-4f8d-889e-fbd6c523519d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086101 Apr 07 17:30:16.742068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 561/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:17.158199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fbe8adf9-e1a3-4ba7-9471-b5ac59b380e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:17.159138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fbe8adf9-e1a3-4ba7-9471-b5ac59b380e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:17.166629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbe8adf9-e1a3-4ba7-9471-b5ac59b380e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:17.167069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbe8adf9-e1a3-4ba7-9471-b5ac59b380e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:17.167819 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbe8adf9-e1a3-4ba7-9471-b5ac59b380e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:17.168251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fbe8adf9-e1a3-4ba7-9471-b5ac59b380e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:17.196122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fbe8adf9-e1a3-4ba7-9471-b5ac59b380e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041819 Apr 07 17:30:17.196599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 554/1115] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:17.758463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:17.759071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:17.765365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:17.765818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:17.766580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:17.767027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:17.827086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:17.835129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ad5c3024-fcd1-4c80-8336-f3a280e51a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080539 Apr 07 17:30:17.835706 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 562/1116] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:18.208559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ff54bb0d-7825-45c5-949a-edb7b228616a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:18.209581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ff54bb0d-7825-45c5-949a-edb7b228616a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:18.215849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff54bb0d-7825-45c5-949a-edb7b228616a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:18.216293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff54bb0d-7825-45c5-949a-edb7b228616a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:18.217057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff54bb0d-7825-45c5-949a-edb7b228616a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:18.217554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff54bb0d-7825-45c5-949a-edb7b228616a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:18.246567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ff54bb0d-7825-45c5-949a-edb7b228616a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042936 Apr 07 17:30:18.247119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 555/1117] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:18.852263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:18.852907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:18.859262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:18.859705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:18.860466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:18.860894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:18.922476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:18.930355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6488a954-51e9-4f77-8c49-4d7a9dea0592 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083215 Apr 07 17:30:18.930916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 563/1118] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:18 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:19.257878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a64772d1-f408-4403-98ca-e1b32fa3d360 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:19.258713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a64772d1-f408-4403-98ca-e1b32fa3d360 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:19.264944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a64772d1-f408-4403-98ca-e1b32fa3d360 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:19.265426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a64772d1-f408-4403-98ca-e1b32fa3d360 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:19.266196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a64772d1-f408-4403-98ca-e1b32fa3d360 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:19.266640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a64772d1-f408-4403-98ca-e1b32fa3d360 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:19.296232 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a64772d1-f408-4403-98ca-e1b32fa3d360 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042352 Apr 07 17:30:19.296781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 556/1119] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:19.947567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:19.948178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:19.954501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:19.954950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:19.955711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:19.956148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:20.013928 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:20.021951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-55c493a1-f4c1-47ce-8f21-94f6d828e1fb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078175 Apr 07 17:30:20.022522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 564/1120] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:20.307846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fca0ebee-54a7-40bb-a615-afaf78cd64fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:20.308672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fca0ebee-54a7-40bb-a615-afaf78cd64fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:20.314956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fca0ebee-54a7-40bb-a615-afaf78cd64fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:20.315403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fca0ebee-54a7-40bb-a615-afaf78cd64fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:20.317346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fca0ebee-54a7-40bb-a615-afaf78cd64fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:20.317777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fca0ebee-54a7-40bb-a615-afaf78cd64fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:20.345337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fca0ebee-54a7-40bb-a615-afaf78cd64fb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041434 Apr 07 17:30:20.345870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 557/1121] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:21.038851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:21.040006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:21.046392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:21.046836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:21.047631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:21.048062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:21.106752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:21.114725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5fd162da-a538-4c92-94d3-0d824efc43c1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079718 Apr 07 17:30:21.115298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 565/1122] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:21 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:21.356963 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1d03a9ed-819f-428f-b632-e8b3a2250b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:21.357843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1d03a9ed-819f-428f-b632-e8b3a2250b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:21.364121 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d03a9ed-819f-428f-b632-e8b3a2250b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:21.364589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d03a9ed-819f-428f-b632-e8b3a2250b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:21.365370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d03a9ed-819f-428f-b632-e8b3a2250b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:21.365802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d03a9ed-819f-428f-b632-e8b3a2250b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:21.393532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1d03a9ed-819f-428f-b632-e8b3a2250b46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040519 Apr 07 17:30:21.394843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 558/1123] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:22.131324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:22.131933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:22.138509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:22.138957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:22.139724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:22.140159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:22.198833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:22.206676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-68fe42d4-9355-4553-bf70-07350ed40057 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078668 Apr 07 17:30:22.207007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 566/1124] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:22.405774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cb94c58e-5ed9-4994-bb41-c28c86e82494 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:22.406625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cb94c58e-5ed9-4994-bb41-c28c86e82494 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:22.413684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb94c58e-5ed9-4994-bb41-c28c86e82494 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:22.414130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb94c58e-5ed9-4994-bb41-c28c86e82494 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:22.414894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb94c58e-5ed9-4994-bb41-c28c86e82494 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:22.415328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb94c58e-5ed9-4994-bb41-c28c86e82494 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:22.442556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cb94c58e-5ed9-4994-bb41-c28c86e82494 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040820 Apr 07 17:30:22.443092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 559/1125] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:23.224250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:23.224845 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:23.231191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:23.231638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:23.232547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:23.232985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:23.295195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:23.302624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2f475227-6a17-4458-b434-4d6696ba47ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083397 Apr 07 17:30:23.303178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 567/1126] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:23.454022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bc41c59f-5594-49e2-8a8c-7c932dc88397 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:23.454941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bc41c59f-5594-49e2-8a8c-7c932dc88397 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:23.461866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc41c59f-5594-49e2-8a8c-7c932dc88397 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:23.462314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc41c59f-5594-49e2-8a8c-7c932dc88397 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:23.463070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc41c59f-5594-49e2-8a8c-7c932dc88397 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:23.463505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc41c59f-5594-49e2-8a8c-7c932dc88397 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:23.491822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bc41c59f-5594-49e2-8a8c-7c932dc88397 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041711 Apr 07 17:30:23.492288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 560/1127] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:24.320131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:24.320741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:24.327095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:24.327548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:24.328319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:24.328760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:24.387863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:24.396013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7f7027b8-cd57-49b1-9b69-34b3d78e58e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080479 Apr 07 17:30:24.396578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 568/1128] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:24.503757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-89b93484-0dfc-4466-8b12-84e006cc499a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:24.504664 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-89b93484-0dfc-4466-8b12-84e006cc499a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:24.510968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b93484-0dfc-4466-8b12-84e006cc499a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:24.511414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b93484-0dfc-4466-8b12-84e006cc499a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:24.512168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b93484-0dfc-4466-8b12-84e006cc499a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:24.512601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89b93484-0dfc-4466-8b12-84e006cc499a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:24.540768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-89b93484-0dfc-4466-8b12-84e006cc499a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041430 Apr 07 17:30:24.541350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 561/1129] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:25.413499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:25.414065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:25.420446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:25.420891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:25.421670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:25.422106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:25.481798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:25.490012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b6828d02-1fc3-4ebe-99c4-9357d4844589 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081006 Apr 07 17:30:25.490570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 569/1130] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:25.552428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-21e2eb50-ded7-415f-991c-fe867831e836 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:25.553401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-21e2eb50-ded7-415f-991c-fe867831e836 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:25.559653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21e2eb50-ded7-415f-991c-fe867831e836 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:25.560095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21e2eb50-ded7-415f-991c-fe867831e836 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:25.560845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21e2eb50-ded7-415f-991c-fe867831e836 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:25.561311 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21e2eb50-ded7-415f-991c-fe867831e836 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:25.589768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-21e2eb50-ded7-415f-991c-fe867831e836 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041890 Apr 07 17:30:25.590305 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 562/1131] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:26.507285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:26.507891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:26.514325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:26.514806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:26.515575 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:26.516011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:26.576307 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:26.584551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ac65ffd8-a017-4943-aa49-d3f7d5bdf83b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081812 Apr 07 17:30:26.585116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 570/1132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:26.601303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a4656497-874c-4396-b4cb-74b8f1c83ff1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:26.602222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a4656497-874c-4396-b4cb-74b8f1c83ff1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:26.608462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4656497-874c-4396-b4cb-74b8f1c83ff1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:26.608909 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4656497-874c-4396-b4cb-74b8f1c83ff1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:26.609692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4656497-874c-4396-b4cb-74b8f1c83ff1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:26.610127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4656497-874c-4396-b4cb-74b8f1c83ff1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:26.637937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a4656497-874c-4396-b4cb-74b8f1c83ff1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040718 Apr 07 17:30:26.638481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 563/1133] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:27.602630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:27.603239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:27.609579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:27.610030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:27.610795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:27.611231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:27.650349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-afba56a3-e27a-4e12-b7db-f26d0e8d0b61 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:27.651303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-afba56a3-e27a-4e12-b7db-f26d0e8d0b61 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:27.660286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afba56a3-e27a-4e12-b7db-f26d0e8d0b61 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:27.660844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afba56a3-e27a-4e12-b7db-f26d0e8d0b61 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:27.661650 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afba56a3-e27a-4e12-b7db-f26d0e8d0b61 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:27.662084 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-afba56a3-e27a-4e12-b7db-f26d0e8d0b61 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:27.672562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:27.680396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ec989b55-4d02-4c3d-94f8-07688e96cb31 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081577 Apr 07 17:30:27.680974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 571/1134] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:27 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:27.691339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-afba56a3-e27a-4e12-b7db-f26d0e8d0b61 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Apr 07 17:30:27.691888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 564/1135] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:28.696325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:28.696935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:28.702564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-130b5db3-d4d3-4f42-b42b-8803a3e228d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:28.703496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-130b5db3-d4d3-4f42-b42b-8803a3e228d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:28.703694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:28.704148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:28.704918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:28.705379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:28.709647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-130b5db3-d4d3-4f42-b42b-8803a3e228d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:28.710109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-130b5db3-d4d3-4f42-b42b-8803a3e228d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:28.710902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-130b5db3-d4d3-4f42-b42b-8803a3e228d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:28.711326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-130b5db3-d4d3-4f42-b42b-8803a3e228d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:28.741735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-130b5db3-d4d3-4f42-b42b-8803a3e228d4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043173 Apr 07 17:30:28.742296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 565/1136] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:28.765607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:28.773129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-71ca1898-3512-4496-b3b0-6d3f9c4b27e2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080683 Apr 07 17:30:28.773985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 572/1137] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:29.754242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2b5504f7-310d-48f9-b3ef-562750d560ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:29.755154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2b5504f7-310d-48f9-b3ef-562750d560ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:29.761507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5504f7-310d-48f9-b3ef-562750d560ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:29.761952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5504f7-310d-48f9-b3ef-562750d560ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:29.762720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5504f7-310d-48f9-b3ef-562750d560ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:29.763153 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5504f7-310d-48f9-b3ef-562750d560ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:29.790015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:29.790729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:29.795395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2b5504f7-310d-48f9-b3ef-562750d560ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045959 Apr 07 17:30:29.796224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 566/1138] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:29.799009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:29.799461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:29.800948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:29.801572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:29.871301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:29.879182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-44f221cd-f866-423d-8401-64c5c6edb4ea tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.093168 Apr 07 17:30:29.879754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 573/1139] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:29 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:30.807344 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8e731d41-af0e-41cd-959a-fcb6daaf9d43 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:30.814792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8e731d41-af0e-41cd-959a-fcb6daaf9d43 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:30.814916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e731d41-af0e-41cd-959a-fcb6daaf9d43 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:30.815362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e731d41-af0e-41cd-959a-fcb6daaf9d43 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:30.816825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e731d41-af0e-41cd-959a-fcb6daaf9d43 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:30.817292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e731d41-af0e-41cd-959a-fcb6daaf9d43 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:30.848614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8e731d41-af0e-41cd-959a-fcb6daaf9d43 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Apr 07 17:30:30.849487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 567/1140] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:30:30.896565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:30.897355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:30.904367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:30.904759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:30.906217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:30.906646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:30.969028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:30.977083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2ef804b7-7465-43d4-8ac3-30bcb52abf33 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084964 Apr 07 17:30:30.977707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 574/1141] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:31.860140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b41efaa4-8547-4883-9777-0c6581984e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:31.861884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b41efaa4-8547-4883-9777-0c6581984e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:31.870318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b41efaa4-8547-4883-9777-0c6581984e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:31.870767 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b41efaa4-8547-4883-9777-0c6581984e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:31.871545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b41efaa4-8547-4883-9777-0c6581984e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:31.871985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b41efaa4-8547-4883-9777-0c6581984e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:31.901878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b41efaa4-8547-4883-9777-0c6581984e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Apr 07 17:30:31.902428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 568/1142] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:30:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:30:31.995931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:31.996539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:32.002589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:32.004079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:32.004372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:32.004807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:32.067663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:32.075526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7af0a839-6aed-420d-859f-cf4e601bead6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084064 Apr 07 17:30:32.076094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 575/1143] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:32.914245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-61f4b679-3eba-4a28-8681-0ba63c702709 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:30:32.915184 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61f4b679-3eba-4a28-8681-0ba63c702709 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:32.921712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f4b679-3eba-4a28-8681-0ba63c702709 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:32.922164 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f4b679-3eba-4a28-8681-0ba63c702709 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:32.922940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f4b679-3eba-4a28-8681-0ba63c702709 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:32.923445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61f4b679-3eba-4a28-8681-0ba63c702709 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:33.003467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-61f4b679-3eba-4a28-8681-0ba63c702709 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/action" status: 200 len: 76960 microversion: 2.1 time: 0.092970 Apr 07 17:30:33.004291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 569/1144] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:30:32 2022] POST /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc/action => generated 76960 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 07 17:30:33.092038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:33.092658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:33.100087 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:33.100612 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:33.101412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:33.102026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:33.163524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:33.173465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3d73adf5-5ab9-4a0e-a9fa-290467c11040 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085135 Apr 07 17:30:33.173993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 576/1145] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:30:33.899553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:33.900130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:33.912119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:33.912259 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:33.913040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:33.913532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:34.191506 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:34.192060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:34.198701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:34.199172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:34.199916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:34.200350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:34.264645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:34.273075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c237ad33-17d4-4437-9fbe-32e3c216d561 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086091 Apr 07 17:30:34.273945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 577/1146] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:34 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:35.290382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:35.290973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:35.297398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:35.297854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:35.298624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:35.299056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:35.361096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:35.369325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f50c0e30-a877-4c97-a75e-b88700676778 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082823 Apr 07 17:30:35.369906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 578/1147] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:36.386837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:36.387550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:36.394068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:36.394522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:36.395289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:36.395722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:36.462060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:36.469593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-45760980-579b-4801-a18d-42a235559812 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086575 Apr 07 17:30:36.470157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 579/1148] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:37.487545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:37.488253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:37.494406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:37.494851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:37.495605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:37.496037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:37.554707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:37.562004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3fe766ea-47b2-4b95-97d7-3ee594824e2a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078904 Apr 07 17:30:37.562559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 580/1149] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:38.579496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:38.580260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:38.586581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:38.587036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:38.587802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:38.588242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:38.652853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:38.655567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-673ffc96-f5af-473b-8acb-614dabccd73a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079925 Apr 07 17:30:38.656144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 581/1150] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:39.672820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:39.673475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:39.680480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:39.680931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:39.681724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:39.682164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:39.741419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:39.748618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-588d881f-a255-4572-9a27-fdb94bb0f2cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079782 Apr 07 17:30:39.749195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 582/1151] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:40.766094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:40.766736 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:40.773938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:40.774387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:40.775153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:40.775592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:40.835746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:40.843583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-af4091cd-5181-47cc-b910-deb11c30dedd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081411 Apr 07 17:30:40.844144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 583/1152] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:41.860574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:41.861238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:41.868139 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:41.868596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:41.869398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:41.869841 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:41.927706 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:41.934966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cf00d9ee-12ff-450b-8439-7b21e4f09557 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078262 Apr 07 17:30:41.935533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 584/1153] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:42.952327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:42.952969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:42.960554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:42.961009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:42.961838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:42.962236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:43.024097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:43.031463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e7b440f7-648b-4ae8-99e7-06591e035724 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083024 Apr 07 17:30:43.032040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 585/1154] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:42 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:44.047768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:44.048514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:44.054997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:44.055449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:44.056221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:44.056663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:44.115645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:44.122960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8f328e30-1fd8-46b5-aeab-20e4dcfcc5a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079108 Apr 07 17:30:44.123529 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 586/1155] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:44 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:45.138821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:45.139443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:45.146555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:45.147009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:45.147784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:45.148224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:45.209816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:45.217189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5a2216ca-2485-49d6-934f-83074e3072b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082253 Apr 07 17:30:45.217687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 587/1156] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:46.234783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:46.235463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:46.242308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:46.242761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:46.243529 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:46.243973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:46.303479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:46.310831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-acff2f3e-aeab-447f-8293-9416a01b8216 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079999 Apr 07 17:30:46.315025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 588/1157] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:46 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:47.328155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:47.328816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:47.336974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:47.337444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:47.338199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:47.338626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:47.398657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:47.405890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b008b541-a35a-4826-b41f-cc44300a1136 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081651 Apr 07 17:30:47.406448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 589/1158] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:48.430860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:48.431541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:48.437860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:48.438305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:48.439074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:48.439511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:48.499143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:48.506675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1e9153ac-0dbb-4817-80dd-e8d829acd667 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079702 Apr 07 17:30:48.507238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 590/1159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:49.523530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:49.524201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:49.530393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:49.530843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:49.531609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:49.532044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:49.593386 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:49.601011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-39afd3db-13d6-46a6-85eb-fb297ece0c0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081619 Apr 07 17:30:49.601600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 591/1160] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:50.618577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:50.619310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:50.625920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:50.626370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:50.627193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:50.627653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:50.687672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:50.695262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-39b7e9db-e8ec-4a82-91a0-eca5f03b6804 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080519 Apr 07 17:30:50.695835 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 592/1161] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:50 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:51.712270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:51.712877 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:51.719255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:51.719708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:51.720468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:51.721592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:51.779623 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:51.787733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bbf458e6-b3cf-4155-baf1-14a36d8ad93e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079360 Apr 07 17:30:51.788299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 593/1162] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:51 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:52.805611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:52.806261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:52.812458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:52.812903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:52.813696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:52.814144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:52.873128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:52.880734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fd81ba78-099b-4046-9877-7e8996af6320 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079011 Apr 07 17:30:52.881328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 594/1163] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:52 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:53.897391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:53.898094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:53.904636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:53.905027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:53.905806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:53.906236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:53.964323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:53.971574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8c920dea-2c38-427d-9998-56b65c217e0f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078081 Apr 07 17:30:53.972134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 595/1164] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:54.988211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:54.988818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:54.995012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:54.995449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:54.996206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:54.996635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:55.058399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:55.066606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2dae98b4-bec3-42ec-8b52-e3e123347398 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082675 Apr 07 17:30:55.067167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 596/1165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:54 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:56.084155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:56.084838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:56.091047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:56.091494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:56.092247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:56.092679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:56.154596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:56.163016 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3c41185f-6e7b-4115-9ce2-7beb80d4c293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083655 Apr 07 17:30:56.163579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 597/1166] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:57.178658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:57.179287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:57.185692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:57.186150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:57.186919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:57.187366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:57.245961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:57.253841 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2515f53d-d57a-49a5-8ddb-4dd7cf29f693 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079049 Apr 07 17:30:57.254412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 598/1167] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:57 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:58.271243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:58.271862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:58.278739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:58.279186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:58.279947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:58.280380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:58.339444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:58.347039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3ba34d2a-2be0-46b8-ba34-f92add491580 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080447 Apr 07 17:30:58.347615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 599/1168] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:30:59.363933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:30:59.364579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:30:59.370781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:59.371219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:59.371983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:30:59.372422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:30:59.431619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:30:59.438883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e77e3f45-b88d-42f9-838c-d992df69b09c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079193 Apr 07 17:30:59.439993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 600/1169] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:30:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:00.457074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:00.457772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:00.464026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:00.464475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:00.465268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:00.465707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:00.525634 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:00.533029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-da08d1a1-8787-4a64-a24e-a1b0f6b0780a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080377 Apr 07 17:31:00.533685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 601/1170] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:01.550346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:01.551019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:01.556979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:01.557458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:01.558227 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:01.558663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:01.616085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:01.623379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-edc8cf68-0d51-4874-8f4d-3fe103aaad64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077614 Apr 07 17:31:01.623946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 602/1171] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:02.640500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:02.641188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:02.648134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:02.648847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:02.649633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:02.650067 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:02.714524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:02.722617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d4cd5e73-aae6-47cc-8571-4cc1c5835454 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085934 Apr 07 17:31:02.723189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 603/1172] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:02 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:03.739511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:03.740131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:03.746430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:03.746872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:03.747625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:03.748054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:03.806217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:03.813457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7440d736-d34a-4f72-9c0f-29f12df8b8de tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077843 Apr 07 17:31:03.814046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 604/1173] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:04.832171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:04.832818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:04.841505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:04.841951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:04.842825 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:04.843278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:04.917021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:04.927421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f110424a-63d8-4170-9e99-4eaaaafb1202 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.100338 Apr 07 17:31:04.927999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 605/1174] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:04 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:05.945006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:05.945678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:05.951961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:05.952415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:05.953203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:05.953644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:06.012254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:06.019584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6ed7ba2d-b49d-4975-837b-366bf57d27a9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078474 Apr 07 17:31:06.020143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 606/1175] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:05 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:07.036220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:07.036848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:07.043098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:07.043538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:07.044291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:07.044721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:07.103657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:07.111109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-00d4ce16-4b12-4b39-9e4b-77b38e927554 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079223 Apr 07 17:31:07.111742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 607/1176] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:08.128190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:08.128850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:08.135035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:08.135479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:08.136229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:08.136658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:08.195791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:08.203107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bd3ac5b4-97f2-4855-81c3-58e72306deb1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079219 Apr 07 17:31:08.203664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 608/1177] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:09.220702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:09.221387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:09.227711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:09.228108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:09.228881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:09.229355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:09.291058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:09.294067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:31:09.294537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:31:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 (ip 10.222.0.26) !!! Apr 07 17:31:09.298696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1cc9ec9a-037b-47f1-b50d-5774855f5337 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081757 Apr 07 17:31:09.299481 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 609/1178] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:09 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:10.315784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:10.316469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:10.322805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:10.323255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:10.324023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:10.324461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:10.384548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:10.392381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-56d2980f-3175-4f4b-b5ce-08da4f1d1c45 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080193 Apr 07 17:31:10.392968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 610/1179] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:11.409893 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:11.410528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:11.416754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:11.417235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:11.417997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:11.418434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:11.477317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:11.484732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-35bde9db-3acb-407b-962f-a92c75c3e6a5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079279 Apr 07 17:31:11.485451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 611/1180] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:12.502968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:12.503661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:12.509912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:12.510357 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:12.511117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:12.511550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:12.570719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:12.577979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ec371f6b-89a0-4051-a532-ab8ee8e1a826 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079080 Apr 07 17:31:12.578539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 612/1181] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:13.595646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:13.596332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:13.602591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:13.603039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:13.603812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:13.604250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:13.666157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:13.674651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b50c9106-7d57-411b-95be-215fdb888703 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083087 Apr 07 17:31:13.675233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 613/1182] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:13.821041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:31:13.821246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:31:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:31:14.691077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:14.691668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:14.698063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:14.698506 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:14.699265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:14.699696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:14.758200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:14.765536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-938237bf-62dc-4fa7-9ff5-60d4b06abe1b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078354 Apr 07 17:31:14.766093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 614/1183] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:15.783740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:15.784416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:15.790630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:15.791076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:15.791833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:15.792265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:15.853824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:15.862033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-23a4a9fc-b516-49fc-a0d9-fa2e53d2234e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082569 Apr 07 17:31:15.862601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 615/1184] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:15 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:16.879787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:16.880421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:16.890071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:16.890512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:16.891267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:16.892803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:16.953426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:16.961832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-da163cdb-646d-4d43-8b7f-0467cadcf293 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086946 Apr 07 17:31:16.962415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 616/1185] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:17.978587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:17.979247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:17.985568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:17.986025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:17.986794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:17.987232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:18.045708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:18.053111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7f112da7-779c-4515-bc3f-c89f62d0f08d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078426 Apr 07 17:31:18.053702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 617/1186] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:19.069643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:19.070360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:19.076440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:19.076886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:19.077678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:19.078117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:19.145471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:19.153037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-17f0241d-dbc3-439a-aa30-96cbc954b06c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.087338 Apr 07 17:31:19.153622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 618/1187] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:20.169791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:20.170450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:20.177661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:20.178107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:20.178865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:20.179300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:20.238644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:20.245960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b7bd4c34-a33a-42f9-ba4e-417adb03b58e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080057 Apr 07 17:31:20.246548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 619/1188] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:21.262934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:21.263621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:21.269860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:21.270314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:21.271084 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:21.271523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:21.329794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:21.337287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e1395dfd-e5a6-42ef-a0c0-e1c709012324 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078227 Apr 07 17:31:21.337859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 620/1189] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:21 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:22.354488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:22.355172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:22.362326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:22.362528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:22.363300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:22.363738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:22.425619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:22.432938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-008029b8-a5fb-47f7-b7df-7195a8573d5d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082329 Apr 07 17:31:22.433532 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 621/1190] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:23.450855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:23.451504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:23.458454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:23.458900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:23.459663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:23.460096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:23.518735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:23.526404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e0e864bf-7643-4886-b27e-f0fa94768115 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079365 Apr 07 17:31:23.526983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 622/1191] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:24.552484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:24.553184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:24.559441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:24.559890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:24.560654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:24.561092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:24.620716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:24.628628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-11ef1cfb-f9b8-41b2-8e78-c6f3a78c76b4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080749 Apr 07 17:31:24.629211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 623/1192] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:25.646265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:25.646949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:25.653910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:25.654166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:25.654942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:25.655378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:25.717550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:25.725436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-16cbef34-198f-4562-9e10-06149648c487 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083983 Apr 07 17:31:25.726002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 624/1193] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:26.742665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:26.743308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:26.749633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:26.750110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:26.750878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:26.751317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:26.813226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:26.821507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1a2c494f-6e51-4616-a689-fbb5ae3d7155 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082713 Apr 07 17:31:26.822072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 625/1194] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:27.838433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:27.839080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:27.845347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:27.845805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:27.847208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:27.847633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:27.906883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:27.914636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-88445165-9d0f-436e-8823-f6d07a98cbdb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080073 Apr 07 17:31:27.915200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 626/1195] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:27 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:28.931661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:28.932311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:28.938517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:28.938962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:28.940330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:28.940802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:29.003527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:29.010919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-281bf1da-855f-4af3-9f90-c42964294ce6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083188 Apr 07 17:31:29.011476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 627/1196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:30.028541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:30.029280 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:30.036306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:30.036760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:30.037559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:30.037999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:30.103134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:30.110351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-89547389-e965-479b-a845-2f956e2a1ecd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085665 Apr 07 17:31:30.110914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 628/1197] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:31.127688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:31.128462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:31.134762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:31.135211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:31.135971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:31.136407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:31.197778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:31.204976 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a9ab233e-5449-49f2-be3c-f57d1f87b232 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081719 Apr 07 17:31:31.206267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 629/1198] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:32.222442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:32.223096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:32.229046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:32.229564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:32.230331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:32.230769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:32.290284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:32.297516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-84dfbe34-7412-42b4-84f7-f9e6e21af8d8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079698 Apr 07 17:31:32.298080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 630/1199] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:32 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:33.314093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:33.315246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:33.321635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:33.322089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:33.322857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:33.323297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:33.382056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:31:33.389578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b73abc50-554e-4b29-99ff-03d01be2c08c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079380 Apr 07 17:31:33.390146 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 631/1200] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:31:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:31:33.958994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:31:33.959487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:31:33.965430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:33.965871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:33.966622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:31:33.967052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:31:38.578200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:31:38.578893 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:31:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 (ip 10.222.0.26) !!! Apr 07 17:31:46.630095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:31:46.630819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:31:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 (ip 10.222.0.26) !!! Apr 07 17:31:56.971394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'services' on Instance uuid fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:31:57.191160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'services' on Instance uuid fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:32:34.104683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3383beae-fc5e-47d7-ad3f-0e5145fc6582) Apr 07 17:32:34.105341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3383beae-fc5e-47d7-ad3f-0e5145fc6582) {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:32:34.106193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1c70012f-be55-4c8f-a823-0d1ce74e1bc7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1" status: 400 len: 269 microversion: 2.1 time: 60.151342 Apr 07 17:32:34.106760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 632/1201] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:31:33 2022] DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 => generated 269 bytes in 60152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 07 17:32:34.111949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:34.113103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:34.119574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.122640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.122640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.122640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.165593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c129cb42-b613-46ed-a657-dbefa5af5bb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1" status: 202 len: 0 microversion: 2.1 time: 120.264892 Apr 07 17:32:34.166837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 570/1202] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:30:33 2022] DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 => generated 0 bytes in 120273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:32:34.173945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:34.174514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:34.182209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.182720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.183485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.183915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.187719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:34.195296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6381f684-dbf6-4bfe-a87f-f8eb8d26c805 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.087571 Apr 07 17:32:34.195890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 633/1203] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:34 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:32:34.200866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:34.201518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:34.209393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:32:34.215179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.215687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.216493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.216957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.244338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:32:34.549329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-648d4520-daec-4579-a264-14e745b43ff8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 204 len: 0 microversion: 2.1 time: 0.380857 Apr 07 17:32:34.549925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 571/1204] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:32:34 2022] DELETE /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:32:34.556338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:34.558275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:34.562636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.563076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.563830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.564295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.577866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bfafd78c-d45e-4bb6-9bd9-0cb30bc312cc tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "DELETE /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 204 len: 0 microversion: 2.20 time: 0.380692 Apr 07 17:32:34.578535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 634/1205] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Apr 7 17:32:34 2022] DELETE /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 07 17:32:34.583644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:34.587189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:34.590127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.590576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.591349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.591787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.734300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:34.742296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-12900172-a966-4326-9e4c-296be1f34cd6 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1673 microversion: 2.1 time: 0.162633 Apr 07 17:32:34.750869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 635/1206] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:34 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:32:34.750869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:34.750869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:34.756437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.756920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.757747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.758177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.888875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:34.897322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:34.899079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:34.900226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c07e02fc-a593-4c0e-9508-019d5fb918ae tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1725 microversion: 2.20 time: 0.156456 Apr 07 17:32:34.900788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 636/1207] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:32:34 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 07 17:32:34.905084 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:34.905600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:34.912008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.912452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.913250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:34.913681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:34.937243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:32:35.037877 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.compute.api [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Instance is already in deleting state, ignoring this request Apr 07 17:32:35.038754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-318a7d5f-1b21-404a-b19c-d5fc4ca263d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "DELETE /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 204 len: 0 microversion: 2.1 time: 0.137045 Apr 07 17:32:35.039518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 637/1208] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:32:34 2022] DELETE /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:32:35.047046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:35.047650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:35.054611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:35.055085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:35.055871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:35.056317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:35.127596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:35.136799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3aeca2f0-b3b6-4361-844c-f2fe9a5a647a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.093258 Apr 07 17:32:35.137616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 638/1209] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:35.761396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:35.762108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:35.768649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:35.769510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:35.770597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:35.771033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:35.852309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:35.860114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5735d187-6fcc-4e38-8854-12cfbab6df4a tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1606 microversion: 2.1 time: 0.102637 Apr 07 17:32:35.860916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 639/1210] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:35 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1606 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:35.919040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:35.919582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:35.927040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:35.927498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:35.928283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:35.928724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.011673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:36.023433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:36.025497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '93ce92053f4a4fa1a639726b2685cec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8370d7baf14d80b8e6f7882864649e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:36.027051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4f91b2ca-5665-4717-b48b-082f9778ebc1 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 200 len: 1657 microversion: 2.20 time: 0.111913 Apr 07 17:32:36.039474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 640/1211] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:32:35 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 1657 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 07 17:32:36.128540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-dc35941e-55ef-4de6-a9d9-33b283ea6d00 req-721960ce-d618-465d-ac90-b5348fdae34a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06", "name": "network-vif-deleted", "tag": "0bee210a-53c0-46e7-98f1-ddf5fee1d97c"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:32:36.138959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-dc35941e-55ef-4de6-a9d9-33b283ea6d00 req-721960ce-d618-465d-ac90-b5348fdae34a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:36.139604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-dc35941e-55ef-4de6-a9d9-33b283ea6d00 req-721960ce-d618-465d-ac90-b5348fdae34a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.157029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-dc35941e-55ef-4de6-a9d9-33b283ea6d00 req-721960ce-d618-465d-ac90-b5348fdae34a service nova] Creating event network-vif-deleted:0bee210a-53c0-46e7-98f1-ddf5fee1d97c for instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 on hv-cinder-83699 Apr 07 17:32:36.164138 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-dc35941e-55ef-4de6-a9d9-33b283ea6d00 req-721960ce-d618-465d-ac90-b5348fdae34a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122719 Apr 07 17:32:36.165334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 641/1212] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:32:36.173233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:36.174230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:36.181793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:36.182544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.183733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:36.184374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.277153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:36.286555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e9a075c9-f4cb-48fa-a853-cb04b90460a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.119487 Apr 07 17:32:36.289624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 642/1213] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:32:36.372296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-e1111e04-ce4f-4000-9922-7e8f1f8d7b92 req-309b9d00-128d-49a6-81ca-efb45812198d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ffd683-613d-4c1a-9df2-0250be28226e", "name": "network-vif-deleted", "tag": "cb147af4-39f2-4945-9290-bc42a9da9fb4"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:32:36.383879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-e1111e04-ce4f-4000-9922-7e8f1f8d7b92 req-309b9d00-128d-49a6-81ca-efb45812198d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:36.384327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-e1111e04-ce4f-4000-9922-7e8f1f8d7b92 req-309b9d00-128d-49a6-81ca-efb45812198d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.398299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-e1111e04-ce4f-4000-9922-7e8f1f8d7b92 req-309b9d00-128d-49a6-81ca-efb45812198d service nova] Creating event network-vif-deleted:cb147af4-39f2-4945-9290-bc42a9da9fb4 for instance 19ffd683-613d-4c1a-9df2-0250be28226e on hv-cinder-83699 Apr 07 17:32:36.403904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-e1111e04-ce4f-4000-9922-7e8f1f8d7b92 req-309b9d00-128d-49a6-81ca-efb45812198d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114474 Apr 07 17:32:36.405295 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 643/1214] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:32:36.881950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:36.882687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:36.890864 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:36.891398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.901200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:36.901200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.935278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:36.936179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:36.936640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lazy-loading 'fault' on Instance uuid 19ffd683-613d-4c1a-9df2-0250be28226e {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:32:36.988581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94e99c7ac26f44f3953fe1296cd5248b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e448dae4841d45baa3fdfbbe6fd0a89c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:36.996992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f0369419-8c4f-4e57-b5f5-69ed458d27f8 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 200 len: 1326 microversion: 2.1 time: 0.122853 Apr 07 17:32:36.997817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 644/1215] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:36 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 1326 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:37.048471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:37.049009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:37.055901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:37.056342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:37.057174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:37.057656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:37.073261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] HTTP exception thrown: Instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 could not be found. Apr 07 17:32:37.073261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Returning 404 to user: Instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:32:37.073676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f7946048-f6d9-4c6f-876a-39fe12d51aa6 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 404 len: 111 microversion: 2.20 time: 0.029864 Apr 07 17:32:37.074365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 645/1216] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:32:37 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:32:37.083345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6571bac2-9d93-456f-a0c8-a06fafd2cbfb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '.version_select at 0x7ff9d07189d0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:37.173439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6571bac2-9d93-456f-a0c8-a06fafd2cbfb tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606672547" status: 204 len: 0 microversion: 2.20 time: 0.094427 Apr 07 17:32:37.174081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 646/1217] 10.222.0.26 () {60 vars in 1261 bytes} [Thu Apr 7 17:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1606672547 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 07 17:32:37.305053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:37.306004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:37.313434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:37.314774 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:37.316319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:37.317666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:37.429908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:37.438407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-716073c5-8dc4-45c5-bdb7-6adafdf184b7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.138169 Apr 07 17:32:37.448785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 647/1218] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:38.014770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:38.015385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:38.021860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:38.022306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:38.023490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:38.023898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:38.037808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] HTTP exception thrown: Instance 19ffd683-613d-4c1a-9df2-0250be28226e could not be found. Apr 07 17:32:38.038407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Returning 404 to user: Instance 19ffd683-613d-4c1a-9df2-0250be28226e could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:32:38.039243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f5368be8-7fb6-45bc-87d5-9185922aae23 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 404 len: 111 microversion: 2.1 time: 0.028463 Apr 07 17:32:38.039788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 648/1219] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:38 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 07 17:32:38.047594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-93b31933-160b-46db-bb04-4af9026a7cf9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '.version_select at 0x7ff9d02cab80>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:38.151348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-93b31933-160b-46db-bb04-4af9026a7cf9 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24160259" status: 202 len: 0 microversion: 2.1 time: 0.107175 Apr 07 17:32:38.153107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 649/1220] 10.222.0.26 () {58 vars in 1214 bytes} [Thu Apr 7 17:32:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24160259 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 07 17:32:38.455881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:38.457605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:38.463236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:38.463633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:38.464409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:38.464848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:38.528281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:38.536451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bd5c4847-1e58-4fbb-815f-4564d421e2bd tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084512 Apr 07 17:32:38.537019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 650/1221] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:39.554416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:39.555086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:39.561365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:39.561819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:39.562579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:39.563015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:39.622893 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:39.630487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e0357bcc-d373-45a7-a916-708b8caa2a60 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080482 Apr 07 17:32:39.631050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 651/1222] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:40.647397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:40.648296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:40.667274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:40.667274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:40.667274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:40.667274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:40.717402 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:40.725010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-393f2a4e-c2de-44e3-8b0c-945fe2467941 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081652 Apr 07 17:32:40.725625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 652/1223] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:41.741890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:41.742484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:41.748810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:41.749292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:41.750055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:41.750491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:41.811601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:41.819485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-335771a2-c46c-4fc2-8ad8-f15cf81e27a6 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081487 Apr 07 17:32:41.820055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 653/1224] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:42.836959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:42.837632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:42.843951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:42.844390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:42.845160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:42.845589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:42.904588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:42.912864 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7dea4b91-8cda-43a3-8533-4ff07eaef82f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079732 Apr 07 17:32:42.913455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 654/1225] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:42 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:32:43.929861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:43.930489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:43.936778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:43.937258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:43.938023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:43.938458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:43.999069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:44.006905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b45755bd-6fb0-4c28-8bbd-576da32857fa tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080864 Apr 07 17:32:44.007468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 655/1226] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:43 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:45.024971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:45.025699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:45.034806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:45.034806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:45.034806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:45.034806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:45.094902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:45.103180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fbb54e04-0763-4e3f-b4ab-9e9f44e668c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082396 Apr 07 17:32:45.103742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 656/1227] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:46.119823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:46.120498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:46.126750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:46.127203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:46.128479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:46.128914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:46.186635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:46.194715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f29e4ca2-7cfb-4a0e-8b35-083d2efff1c3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078781 Apr 07 17:32:46.195282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 657/1228] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:46 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:47.211488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:47.212107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:47.218483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:47.218934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:47.219725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:47.220145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:47.280695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:47.289150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-568fa8cf-6dd3-4921-aaf2-26483f049fc0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081535 Apr 07 17:32:47.289738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 658/1229] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:48.507676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:48.508431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:48.514435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:48.514887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:48.515657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:48.516095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:48.574716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:48.583056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e09d8cbf-799a-4213-a751-cf9232215bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.281897 Apr 07 17:32:48.583620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 659/1230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:49.599346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:49.599981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:49.606265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:49.606709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:49.607470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:49.607904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:49.666647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:49.674046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6ec3ccc3-06c7-4c48-b9ea-a49289a11162 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079124 Apr 07 17:32:49.675504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 660/1231] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:50.690718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:50.691322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:50.697754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:50.698211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:50.698985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:50.699430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:50.763459 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:50.769378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ba228bcc-3f0a-4a17-a249-36f32519a8ce tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082317 Apr 07 17:32:50.769943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 661/1232] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:50 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:51.786574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:51.787221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:51.793455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:51.793902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:51.794659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:51.795091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:51.853725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:51.861004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-132fb5e4-22c8-4900-8494-d411f114a05e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078981 Apr 07 17:32:51.861594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 662/1233] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:51 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:52.879017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:52.879649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:52.885971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:52.886423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:52.887187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:52.887630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:52.946074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:52.953301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-72c0af7a-1e37-48b1-a5ed-4d693d0c5949 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078798 Apr 07 17:32:52.953878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 663/1234] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:52 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:53.970526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:53.971327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:53.977518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:53.977971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:53.978741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:53.979182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:54.039391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:54.046833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d2c213f4-ed84-44cd-84cd-754a1244b779 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080132 Apr 07 17:32:54.047405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 664/1235] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:55.064079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:55.064739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:55.071805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:55.072251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:55.073014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:55.073480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:55.136100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:55.145980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c7915fd4-7e13-42d7-ba4c-f4e33ae4e9cf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085674 Apr 07 17:32:55.147091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 665/1236] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:56.163433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:56.164093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:56.170309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:56.170757 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:56.171517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:56.171962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:56.230573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:56.238639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6fce4794-ec52-4220-82a8-1dd76c594a7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079187 Apr 07 17:32:56.239198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 666/1237] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:57.255391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:57.255992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:57.262323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:57.262775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:57.263539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:57.263976 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:57.328786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:57.336581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-66f0872e-9bc1-479a-8f0d-7aa7402b6677 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085259 Apr 07 17:32:57.337172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 667/1238] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:57 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:58.354286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:58.354950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:58.361179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:58.361771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:58.362552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:58.362997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:58.421805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:58.429190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-08d79e02-5118-45e5-aaa8-8237623316c2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078695 Apr 07 17:32:58.429760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 668/1239] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:32:59.445847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:32:59.446497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:32:59.452595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:59.453049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:59.453836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:32:59.454272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:32:59.512410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:32:59.520445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7593ebef-d46c-4fe4-a930-e5ee9c5966f0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078454 Apr 07 17:32:59.521001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 669/1240] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:32:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:33:00.537872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:00.538547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:00.544704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:00.545182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:00.545953 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:00.546388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:00.604540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:00.611919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1ef1aff4-576f-47f3-bade-dde298f28f52 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078516 Apr 07 17:33:00.613647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 670/1241] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:01.630795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:01.631524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:01.637403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:01.637860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:01.638630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:01.639069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:01.700341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:01.708345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bc4e4f7f-02b1-4d0e-b9db-418fdde4789b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082326 Apr 07 17:33:01.708920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 671/1242] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:02.725460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:02.726066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:02.732899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:02.733378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:02.734148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:02.734588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:02.792834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:02.800171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8cc9b2ea-1e06-4094-a2bb-4c977e23ddd2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078811 Apr 07 17:33:02.800741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 672/1243] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:02 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:03.817611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:03.818257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:03.824497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:03.824947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:03.825732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:03.826173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:03.888139 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:03.896246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c61f92f4-b2bf-4502-982c-d6db38f72287 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083149 Apr 07 17:33:03.896814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 673/1244] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:04.913540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:04.914174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:04.920223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:04.920667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:04.921460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:04.921893 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:05.199912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:05.207597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e9acefc6-d09a-495a-bf3a-c9ef4d4b3187 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.298310 Apr 07 17:33:05.208168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 674/1245] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:04 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:06.225155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:06.225822 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:06.232047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:06.232492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:06.233276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:06.233712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:06.292759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:06.300602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bce75383-df48-4812-894f-9e487e21f954 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080376 Apr 07 17:33:06.301189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 675/1246] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:06 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:07.318387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:07.319007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:07.325523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:07.325970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:07.327320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:07.327759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:07.401849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:07.410157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-64babdca-47b0-4ca5-a240-4980d7f122b2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.096860 Apr 07 17:33:07.410734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 676/1247] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:08.427310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:08.427989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:08.434233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:08.434676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:08.435430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:08.435859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:08.496053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:08.503646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-360b6074-d45e-42c5-9925-d7e4b8133d73 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080463 Apr 07 17:33:08.504292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 677/1248] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:09.521528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:09.522179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:09.528801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:09.529301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:09.530080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:09.530519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:09.591244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:09.598516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d0a46f1e-6225-4dcb-9eb4-417037af9e4d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081424 Apr 07 17:33:09.599074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 678/1249] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:09 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:10.615618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:10.616306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:10.622707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:10.623166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:10.623941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:10.624382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:10.683824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:10.691895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fcaeedaf-d484-4ade-b5d8-53a63a83210e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080661 Apr 07 17:33:10.695602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 679/1250] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:33:10.744055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:33:10.744619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:33:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 (ip 10.222.0.26) !!! Apr 07 17:33:11.708448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:11.709052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:11.715350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:11.715797 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:11.716560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:11.716996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:11.775619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:11.782919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a5e44c93-690f-4d7f-9c93-3a1bc4213534 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079005 Apr 07 17:33:11.783489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 680/1251] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:12.799805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:12.800468 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:12.806639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:12.807094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:12.807891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:12.808331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:12.866422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:12.873784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7540a583-100b-4a1c-8d9e-c5f413af5df5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077951 Apr 07 17:33:12.874347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 681/1252] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:13.890793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:13.891448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:13.898589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:13.899037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:13.899833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:13.900275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:13.958930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:13.966250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-eb97d98c-3391-46ae-bb20-05fb2edf2620 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079349 Apr 07 17:33:13.966810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 682/1253] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:14.983328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:14.988019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:14.991292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:14.991741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:14.992496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:14.992934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:15.053810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:15.061259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a3d84436-6f89-41dd-ba4c-a1241f4c7d7c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081827 Apr 07 17:33:15.061821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 683/1254] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:16.079052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:16.079748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:16.086191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:16.086643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:16.087409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:16.087844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:16.151063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:16.158341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8ea2f317-c5e0-49a2-bca3-b51b7d4ede83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083177 Apr 07 17:33:16.159431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 684/1255] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:16 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:33:17.176419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:17.177056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:17.183514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:17.183960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:17.184716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:17.185163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:17.244147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:17.251456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bb56eb88-bb9f-40c7-96fc-b300756c1a8f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079150 Apr 07 17:33:17.252022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 685/1256] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:18.269651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:18.270266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:18.276832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:18.277319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:18.278083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:18.278519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:18.337339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:18.344635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a276ac00-2022-4a76-8843-36a78f49ce46 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079497 Apr 07 17:33:18.345225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 686/1257] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:18 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:19.362377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:19.362986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:19.368880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:19.369368 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:19.370145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:19.370590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:19.429717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:19.436998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a5aabf35-feff-4d7b-b5b0-cfab60f6bb93 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078944 Apr 07 17:33:19.437601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 687/1258] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:20.454637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:20.455306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:20.462609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:20.463058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:20.463813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:20.464242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:20.529739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:20.537808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4fc88006-ddd7-42b9-ab79-a0915782526c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086957 Apr 07 17:33:20.538369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 688/1259] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:21.555173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:21.555841 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:21.562072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:21.562530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:21.563305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:21.563748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:21.621835 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:21.629384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-17f11e32-96af-4596-a777-f7f615077a91 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078028 Apr 07 17:33:21.629950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 689/1260] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:21 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:22.646314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:22.647005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:22.653954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:22.654202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:22.654976 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:22.655417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:22.720387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:22.728027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a854fe33-f7f8-410b-9734-bea7fb859076 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086516 Apr 07 17:33:22.728587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 690/1261] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:23.745600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:23.746232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:23.752633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:23.753081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:23.753890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:23.754329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:23.812779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:23.820644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-55a76372-f8ca-44a2-8ef2-3f011bbb745b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079004 Apr 07 17:33:23.821221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 691/1262] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:24.837359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:24.838052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:24.844334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:24.844783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:24.845569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:24.846095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:24.905697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:24.912946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cb4080b5-46f2-4d8d-81da-443c028f94f1 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079457 Apr 07 17:33:24.913549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 692/1263] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:25.929860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:25.930513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:25.936787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:25.937272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:25.938041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:25.938481 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:25.997353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:26.005265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-18b26b07-030a-4f23-a1b8-3dc4780d6aa8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079303 Apr 07 17:33:26.005836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 693/1264] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:27.022778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:27.023452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:27.029621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:27.030070 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:27.030824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:27.031255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:27.090906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:27.098444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-10851ce6-09f0-46aa-a0cd-e4f533422b83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080325 Apr 07 17:33:27.099044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 694/1265] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:27 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:28.116546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:28.117269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:28.123169 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:28.123611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:28.124365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:28.124802 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:28.184796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:28.192396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0aee210e-d97d-49e4-a210-93076c64a68e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080971 Apr 07 17:33:28.192953 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 695/1266] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:28 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:29.210398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:29.211034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:29.217447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:29.217889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:29.218681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:29.219119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:29.281639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:29.289480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-27a64076-0b37-4359-8827-2e435be1dd30 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084184 Apr 07 17:33:29.290397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 696/1267] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:29 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:30.307773 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:30.308462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:30.316058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:30.316501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:30.317290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:30.317723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:30.378774 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:30.385906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-497c73ab-cd52-43cc-a0b6-aa66bc8f0b0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082005 Apr 07 17:33:30.386485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 697/1268] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:31.403427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:31.404056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:31.409918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:31.410369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:31.411130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:31.411566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:31.470661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:31.478049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-95409ec4-8f41-4e5e-aa6e-075cf07b2166 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078651 Apr 07 17:33:31.478610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 698/1269] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:32.495581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:32.496284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:32.503069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:32.503524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:32.504308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:32.504752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:32.562507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:32.570479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a8eb27e7-6afb-4fa3-ab8f-55ef7509be0e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078743 Apr 07 17:33:32.571072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 699/1270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:32 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:33.587105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:33.587776 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:33.594136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:33.595131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:33.595349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:33.596358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:33.654967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:33:33.663285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a8eea62c-a135-4453-bf5b-86305e57b127 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080061 Apr 07 17:33:33.663857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 700/1271] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:33:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:33:34.179452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:33:34.179972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:33:34.185723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:34.186165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:34.186915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:33:34.187345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:33:57.371764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'services' on Instance uuid fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:33:57.513583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'services' on Instance uuid fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:34:29.302613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:34:29.303191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:34:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 (ip 10.222.0.26) !!! Apr 07 17:34:33.830558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:34:33.831117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:34:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 (ip 10.222.0.26) !!! Apr 07 17:34:34.248946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d5042b5a-7b1e-4503-b36e-8cef52dcc930) Apr 07 17:34:34.249611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d5042b5a-7b1e-4503-b36e-8cef52dcc930) {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:34:34.250518 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9e880fb5-ed5f-475b-8b2f-d28104b5ecc2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1" status: 400 len: 269 microversion: 2.1 time: 119.698619 Apr 07 17:34:34.251078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 572/1272] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:32:34 2022] DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 => generated 269 bytes in 119701 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:34:34.256961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:34.259080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:34.265857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:34.266387 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:34.267904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:34.268412 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:34.287978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0991bcfc-38be-4f64-ac1c-1104d791f07b) Apr 07 17:34:34.288607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0991bcfc-38be-4f64-ac1c-1104d791f07b) {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:34:34.289482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3fb9aa0c-4e64-4c79-8827-003c6d040fc9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1" status: 400 len: 269 microversion: 2.1 time: 60.233334 Apr 07 17:34:34.290036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 701/1273] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:33:34 2022] DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 => generated 269 bytes in 60235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 07 17:34:34.296182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:34.296675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:34.303036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:34.303494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:34.304267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:34.304707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:34.341465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:34.349801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-83e90ade-5a70-42c5-b5d5-4a3c4c87c527 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.097615 Apr 07 17:34:34.350363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 573/1274] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:34 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:34.447639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lazy-loading 'services' on Instance uuid fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:34:34.500837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89a73d9-8586-49f7-b1a9-70c360d60f01) Apr 07 17:34:34.502126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f89a73d9-8586-49f7-b1a9-70c360d60f01) {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:34:34.503059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-93acf1b9-22fe-4108-bd8f-5fec46215398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1" status: 400 len: 269 microversion: 2.1 time: 0.211503 Apr 07 17:34:34.503632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 702/1275] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:34:34 2022] DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3/os-volume_attachments/ab73a3bf-f706-413a-8756-9d671d3384b1 => generated 269 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:34:35.367550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:35.368082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:35.374335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:35.374779 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:35.375576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:35.376009 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:35.434941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:35.442758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d4bc8a90-29b6-4efa-9427-ae4666214b96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079254 Apr 07 17:34:35.443308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 574/1276] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:36.460210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:36.460854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:36.466866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:36.467320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:36.468118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:36.468557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:36.528650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:36.537162 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-080e6166-81fd-4ef4-ac6f-868df2f7441a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081312 Apr 07 17:34:36.537728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 703/1277] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:37.553260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:37.553872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:37.560299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:37.560748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:37.561537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:37.561970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:37.624440 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:37.632469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2469386d-89da-49d4-aaa9-4a0d846d0d58 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083178 Apr 07 17:34:37.633046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 575/1278] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:38.649606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:38.650118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:38.656407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:38.656859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:38.658305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:38.658705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:38.717715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:38.725768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e4ba59ed-6ad6-495c-b06a-150bc515437d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080492 Apr 07 17:34:38.726331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 704/1279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:39.742833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:39.743436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:39.749630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:39.750070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:39.750826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:39.752418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:39.811682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:39.819398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fedfd6b1-8604-4350-a329-63b019eb27af tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080382 Apr 07 17:34:39.819988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 576/1280] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:39 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:40.836239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:40.836857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:40.843258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:40.843710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:40.844480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:40.845461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:40.904208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:40.912098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6188951d-0b2b-4748-810f-aa219bd5629f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079746 Apr 07 17:34:40.912673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 705/1281] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:41.929367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:41.929974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:41.936157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:41.936595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:41.937375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:41.937806 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:41.999226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:42.007067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-48dd49d1-d806-4b40-bcd1-2a5905d01dc5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081526 Apr 07 17:34:42.007615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 577/1282] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:43.024119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:43.024727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:43.031033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:43.031485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:43.032756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:43.033230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:43.092408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:43.099874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-029b4314-8c63-46d3-b905-49b3b4362ef3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079902 Apr 07 17:34:43.100438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 706/1283] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:43 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:44.116844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:44.117520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:44.123740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:44.124181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:44.124929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:44.125390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:44.184813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:44.192135 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2ffd5feb-fd2e-4506-81b7-cbd800357fa3 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079516 Apr 07 17:34:44.192689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 578/1284] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:44 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:45.209524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:45.210132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:45.216410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:45.216863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:45.217657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:45.218096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:45.278486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:45.286562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b37f0c81-a9bd-4d70-b8ba-9868de3f30bc tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080878 Apr 07 17:34:45.287171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 707/1285] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:46.304212 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:46.304806 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:46.311038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:46.311486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:46.312235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:46.312662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:46.373974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:46.381307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-92701bc1-011a-4fc9-9c7e-18845e70c8ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081021 Apr 07 17:34:46.381855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 579/1286] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:46 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:47.398977 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:47.399500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:47.405711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:47.406149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:47.406989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:47.407422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:47.466580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:47.474686 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8ead7984-befc-4730-8b03-baa9a904a5c7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079976 Apr 07 17:34:47.475242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 708/1287] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:34:48.492038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:48.492642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:48.498925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:48.499369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:48.500122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:48.500555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:48.560036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:48.567639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cdcf19b7-2008-4050-a348-3ef1c451f898 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080077 Apr 07 17:34:48.568201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 580/1288] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:49.584363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:49.584969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:49.591265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:49.591722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:49.592480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:49.592916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:49.651147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:49.658870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1a630e75-8cf7-4953-9c52-ae5bcbc9013f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.077956 Apr 07 17:34:49.659590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 709/1289] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:50.676511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:50.677128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:50.683404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:50.683851 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:50.684614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:50.685050 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:50.747826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:50.755980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-59d5fe60-e1bd-4dc5-9df8-df9de7d5e82a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084123 Apr 07 17:34:50.756545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 581/1290] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:50 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:51.772865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:51.773500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:51.779775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:51.780223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:51.780988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:51.781449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:51.845704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:51.853756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-74a6b606-7feb-4f25-aabf-fa2995808f14 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085869 Apr 07 17:34:51.854320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 710/1291] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:51 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:52.870784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:52.871396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:52.877809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:52.878265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:52.879029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:52.879466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:52.938420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:52.945890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-abce1f31-76e2-41a2-b391-4ae46756d484 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078989 Apr 07 17:34:52.946450 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 582/1292] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:52 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:53.963456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:53.964109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:53.970404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:53.971834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:53.972609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:53.973047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:54.031231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:54.039574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c6f08c0f-1840-45ab-9b3d-1a0f65f8ce0a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079979 Apr 07 17:34:54.040132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 711/1293] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:55.056010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:55.056610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:55.063025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:55.063470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:55.064227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:55.065469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:55.126710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:55.135058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0574e6df-76bf-45bf-9c6e-9083b3a68edb tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082923 Apr 07 17:34:55.135608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 583/1294] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:56.152728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:56.153404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:56.160417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:56.160871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:56.161670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:56.162107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:56.219511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:56.227554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-97c03ea2-f008-41c5-b919-b6fe850dfe42 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078578 Apr 07 17:34:56.228119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 712/1295] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:57.245073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:57.245710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:57.252631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:57.253086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:57.253876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:57.254345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:57.312628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:57.320720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5556a0b9-4ae9-4c83-92ad-948946196c5b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079530 Apr 07 17:34:57.321318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 584/1296] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:57 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:58.337130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:58.337751 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:58.343958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:58.344401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:58.345177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:58.346008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:58.523031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:58.530489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1b65c95a-9245-442b-b1b1-ddfec5dba03b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.197207 Apr 07 17:34:58.531054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 713/1297] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:34:58.587044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:34:58.587245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:34:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:34:59.547605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:34:59.548297 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:34:59.555550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:59.555988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:59.556740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:34:59.557194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:34:59.619929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:34:59.627642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bc78dc5e-1c6d-4b68-9d23-c860b8232a71 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083475 Apr 07 17:34:59.628207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 585/1298] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:34:59 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:00.645307 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:00.645917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:00.652382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:00.652831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:00.653633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:00.654069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:00.712973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:00.720254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7741e3ac-d9df-4b18-b2eb-8eb351fe833c tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079632 Apr 07 17:35:00.721161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 714/1299] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:00 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:01.737174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:01.737772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:01.744018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:01.744463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:01.745246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:01.745680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:01.807747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:01.815276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3071485b-16d1-429f-9bc5-730764d1dac8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081977 Apr 07 17:35:01.815838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 586/1300] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:01 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:02.831914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:02.832558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:02.838541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:02.839001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:02.839776 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:02.840219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:02.898715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:02.906120 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0986f5ac-b65d-4c75-beba-bc4c73dacc7d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078173 Apr 07 17:35:02.906641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 715/1301] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:02 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:03.923011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:03.924122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:03.930500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:03.930951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:03.931715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:03.932175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:03.992530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:03.999879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-075249b2-19f6-487e-a956-5e18262c944a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080706 Apr 07 17:35:04.000438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 587/1302] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:03 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:05.018000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:05.018656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:05.025082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:05.025569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:05.026339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:05.026778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:05.089874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:05.097121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-77583bc6-b388-4b65-9d14-f07cab12c453 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083722 Apr 07 17:35:05.097708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 716/1303] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:05 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:06.114770 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:06.115383 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:06.121327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:06.121775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:06.122540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:06.122975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:06.180877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:06.188197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6e402d45-89b4-45a7-b917-f2d862259370 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078142 Apr 07 17:35:06.188755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 588/1304] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:06 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:06.638218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:35:06.638787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:35:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:35:07.208558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:07.209195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:07.216738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:07.217209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:07.217977 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:07.218410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:07.289846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:07.297550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1a8f6dfd-2cab-4d96-9d58-136757d3af9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.094875 Apr 07 17:35:07.298106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 717/1305] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:07 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:08.318699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:08.319301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:08.325716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:08.326185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:08.326938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:08.327368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:08.385990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:08.393303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-65c0627c-1876-4b9e-a875-728c61788897 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079473 Apr 07 17:35:08.394067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 589/1306] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:08 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:09.411823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:09.412378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:09.418644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:09.419090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:09.419847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:09.420277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:09.479426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:09.487871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f2ed592d-8889-41fc-ad71-a3e9e2429e9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081367 Apr 07 17:35:09.488432 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 718/1307] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:09 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:10.505192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:10.505800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:10.512034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:10.512478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:10.513269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:10.513706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:10.572538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:10.579936 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a4f036ff-e1e7-4165-afc8-709940fa2ea4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079143 Apr 07 17:35:10.580477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 590/1308] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:10 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:11.597474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:11.598077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:11.604405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:11.604856 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:11.605651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:11.606118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:11.667628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:11.675524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f6c96548-89bf-49e7-8dd2-bc4452da9443 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082564 Apr 07 17:35:11.676092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 719/1309] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:11 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:12.693089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:12.693773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:12.700267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:12.700721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:12.701537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:12.701977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:12.761120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:12.768490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-730e73f7-0797-418d-96b1-20cfdb9a5d8d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079747 Apr 07 17:35:12.769051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 591/1310] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:12 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:13.786061 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:13.786669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:13.793120 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:13.793607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:13.794428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:13.794872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:13.854662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:13.862424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-14bd29a9-b0b0-4000-88eb-d1c2d8622743 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080941 Apr 07 17:35:13.862981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 720/1311] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:13 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:14.879066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:14.879684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:14.885936 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:14.886384 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:14.887148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:14.887580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:14.946457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:14.953758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-682f4b28-f457-48a6-a469-ffae8f750296 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078554 Apr 07 17:35:14.954829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 592/1312] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:14 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:15.971242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:15.971850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:15.978202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:15.978648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:15.979401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:15.979834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:16.039848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:16.047174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9d04d63f-0b7b-4760-93a1-a3600f4ffec7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080414 Apr 07 17:35:16.047740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 721/1313] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:15 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:17.066008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:17.066620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:17.072995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:17.073481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:17.074296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:17.074733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:17.134366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:17.141664 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-728bc325-0e57-474c-ad41-377ecf6a5dc9 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080156 Apr 07 17:35:17.143144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 593/1314] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:17 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:18.159948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:18.160552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:18.166832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:18.167272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:18.168026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:18.168459 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:18.229128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:18.237062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1c6424fd-0296-4ed4-9bd2-de6fb5e0790b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081113 Apr 07 17:35:18.237644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 722/1315] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:18 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:35:19.253569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:19.254174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:19.260461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:19.260904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:19.261700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:19.262131 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:19.322251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:19.329416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a487690a-1fbf-4962-a5b1-f3f905f60323 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080027 Apr 07 17:35:19.330531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 594/1316] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:19 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:20.347326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:20.347922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:20.354444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:20.354901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:20.355669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:20.356109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:20.414863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:20.422151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7c5c6f16-e8bf-45a4-820f-7948c6542cf8 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079382 Apr 07 17:35:20.422709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 723/1317] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:20 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:21.438886 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:21.439497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:21.445931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:21.446374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:21.447130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:21.447595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:21.506250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:21.513409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-647bce71-7abb-44ed-927b-57cf4722ed9f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078416 Apr 07 17:35:21.513970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 595/1318] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:21 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:22.530518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:22.531121 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:22.538452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:22.538898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:22.539646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:22.540077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:22.598904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:22.606049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f9a370d5-e3cd-4a71-b206-8fb058288711 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079335 Apr 07 17:35:22.606602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 724/1319] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:22 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:23.623127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:23.623744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:23.630126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:23.630573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:23.631336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:23.631797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:23.691824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:23.699182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0da5efc9-bd6b-48a4-a069-67ebb47ec753 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079936 Apr 07 17:35:23.699749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 596/1320] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:23 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:24.716445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:24.717046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:24.723438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:24.723884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:24.724637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:24.725065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:24.787191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:24.794400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f0e8e2e7-d21f-475c-950f-a292b296381a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081797 Apr 07 17:35:24.794960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 725/1321] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:24 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:25.811822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:25.812500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:25.818948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:25.819397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:25.820160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:25.820597 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:25.883830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:25.891109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fc5415d3-8221-432a-a996-61e85899eab5 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.083202 Apr 07 17:35:25.892316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 597/1322] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:25 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:26.908315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:26.908929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:26.915693 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:26.916142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:26.916906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:26.917375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:26.977852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:26.985166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5902b6a1-b273-4714-9a35-3e0399a8bd1e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080610 Apr 07 17:35:26.985765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 726/1323] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:26 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:28.002672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:28.003279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:28.009616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:28.010066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:28.010829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:28.011266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:28.069865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:28.077106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c6fbf979-1bd4-4811-971c-52617d718bb4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078832 Apr 07 17:35:28.077689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 598/1324] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:27 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:29.095464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:29.096163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:29.102498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:29.107785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:29.107785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:29.107785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:29.163298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:29.170519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ca34b048-2bf7-4355-8376-c51355b99303 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079754 Apr 07 17:35:29.171076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 727/1325] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:29 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:30.187326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:30.187964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:30.194891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:30.195337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:30.196099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:30.196560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:30.254847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:30.262154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-47e45b97-8430-46c4-98a0-afc908086f5f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078714 Apr 07 17:35:30.262712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 599/1326] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:30 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:31.280189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:31.280794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:31.287859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:31.288305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:31.289057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:31.289516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:31.350888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:31.358126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9251eb25-3a3a-4782-a6ea-9a2bfcf4f0f4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081783 Apr 07 17:35:31.358689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 728/1327] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:31 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:32.374994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:32.375601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:32.381843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:32.382286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:32.383037 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:32.383468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:32.444707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:32.451880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-625a16ae-04c2-437e-84e5-4480c27ebcf2 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080810 Apr 07 17:35:32.452461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 600/1328] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:32 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:33.469002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:33.470732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:33.476967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:33.477442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:33.478200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:33.478633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:33.538613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:33.545943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bb409951-2eaf-4501-94f0-ea54d5f8ec3d tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080765 Apr 07 17:35:33.546518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 729/1329] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:33 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:34.562753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:34.563891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:34.569955 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:34.570406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:34.571168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:34.571611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:34.630880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:34.638564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b557ff1a-2d42-4281-a055-b51190848248 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079632 Apr 07 17:35:34.642531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 601/1330] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:34 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:35.655939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:35.656546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:35.662959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:35.663416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:35.664189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:35.664633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:35.723516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:35.730757 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-49730c87-50cf-4c26-85f7-3c1d0d69e45f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078773 Apr 07 17:35:35.731325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 730/1331] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:35 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:36.747997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:36.748606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:36.755533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:36.755982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:36.756739 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:36.757196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:36.815234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:36.822378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-40be618b-a044-4874-88d1-c2e1cafdde96 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078236 Apr 07 17:35:36.822941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 602/1332] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:36 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:37.839377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:37.840011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:37.847360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:37.847805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:37.848559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:37.848990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:37.913752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:37.921182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9e1a0970-3d61-4772-ae85-12cb23155617 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.085650 Apr 07 17:35:37.921748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 731/1333] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:37 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:38.937974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:38.938583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:38.944797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:38.945278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:38.946044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:38.946480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:39.007839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:39.015231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-799ad66c-99cd-46c9-a50b-2c44cf313f17 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081231 Apr 07 17:35:39.015787 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 603/1334] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:38 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:40.033542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:40.034161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:40.040495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:40.040941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:40.041807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:40.042244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:40.100601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:40.107895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fb83dc52-1300-49ff-a422-9a1592ae33a0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078730 Apr 07 17:35:40.108458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 732/1335] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:40 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:41.123756 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:41.124372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:41.131143 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:41.131594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:41.132363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:41.132804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:41.191862 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:41.199120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7a4f900e-03d6-4e1c-8234-921e1686096f tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079247 Apr 07 17:35:41.199699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 604/1336] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:41 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:42.216507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:42.217115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:42.223930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:42.224378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:42.225157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:42.225601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:42.285602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:42.292914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b7efab15-a4d9-4585-bbed-86e44455cd7e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080203 Apr 07 17:35:42.293538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 733/1337] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:42 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:43.309812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:43.310427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:43.317652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:43.318106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:43.318874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:43.319315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:43.377869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:43.385093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7f243c94-db24-4862-a531-2e053c71e8a7 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079154 Apr 07 17:35:43.385717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 605/1338] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:43 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:44.402093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:44.402694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:44.409950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:44.410392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:44.411147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:44.411582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:44.473974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:44.481189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-96d7e94d-68d4-4db9-8313-df7bb06646d0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082909 Apr 07 17:35:44.481747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 734/1339] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:44 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:45.497368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:45.497980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:45.504907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:45.505394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:45.506156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:45.506592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:45.564801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:45.572022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-20d49b46-fd44-4b57-ba6d-d5470ab0beed tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078615 Apr 07 17:35:45.572585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 606/1340] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:45 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:46.588912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:46.589546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:46.596434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:46.596875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:46.597662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:46.598095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:46.660211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:46.667637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4600b41c-4c24-4239-ac82-404f6b37080b tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.082619 Apr 07 17:35:46.668201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 735/1341] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:46 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:47.683708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:47.684319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:47.691233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:47.691684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:47.692452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:47.692887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:47.753928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:47.761174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8f21a99d-2f12-441f-b80d-a900a37c307e tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081294 Apr 07 17:35:47.761727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 607/1342] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:47 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:48.778237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:48.778860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:48.785260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:48.785712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:48.786475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:48.786917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:48.845104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:48.852370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-02ec7073-575a-4bc0-b3c6-a3b65c7a0027 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078080 Apr 07 17:35:48.852939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 736/1343] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:48 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:49.869840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:49.870474 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:49.877225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:49.877668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:49.878428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:49.878856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:49.938966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:49.946395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a1cf1150-de96-4b0b-ae68-20a9b1eead64 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080446 Apr 07 17:35:49.946972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 608/1344] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:49 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:50.963817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:50.964443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:50.971090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:50.971537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:50.972292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:50.972723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:51.033977 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:51.041170 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-48bc2b96-99ad-4830-afcb-e36df8afb313 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.081177 Apr 07 17:35:51.041739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 737/1345] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:50 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:52.058705 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:52.059314 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:52.066297 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:52.066749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:52.067509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:52.067945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:52.125942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:52.133106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-45c5d787-9804-45b8-96c3-3eaa7ef96bdf tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078258 Apr 07 17:35:52.133692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 609/1346] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:52 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:53.150615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:53.151231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:53.157655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:53.158141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:53.158923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:53.159351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:53.218046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:53.225566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f638de94-4940-47b0-9298-be81a7a60767 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.079038 Apr 07 17:35:53.226125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 738/1347] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:53 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:54.243192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:54.243783 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:54.254408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:54.254869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:54.255624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:54.256057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:54.318559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:54.325840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b88c0ab4-e170-4dee-ac8b-31243a715204 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.086704 Apr 07 17:35:54.326417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 610/1348] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:54 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:55.343366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:55.344144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:55.350346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:55.350786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:55.351556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:55.351997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:55.412806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:55.420185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5878d1f5-508f-460b-b833-ba3cd479a3e0 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.080959 Apr 07 17:35:55.421734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 739/1349] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:55 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:56.437533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:56.438604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:56.444454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:56.444904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:56.445689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:56.446129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:56.504263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:56.511951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3098ccc5-be91-4264-9c19-b6ecaf30627a tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.078186 Apr 07 17:35:56.512519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 611/1350] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:56 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:57.528654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:57.529334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:57.536214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:57.536657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:57.537443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:57.537875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:57.601229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba927321673a4369a04500bee576f545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2cc28c058a54a7185d686c81dc0a3f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:35:57.609073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-019b0cda-96be-409f-bae5-d463ed786a83 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 200 len: 1224 microversion: 2.1 time: 0.084204 Apr 07 17:35:57.610428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 740/1351] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:57 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:35:58.627263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:35:58.627853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] [instance: 29493f81-0b41-4e00-9b9a-08301cc1d2b0] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:35:58.634186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:58.634640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:58.635404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:35:58.635840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:35:58.649535 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] HTTP exception thrown: Instance 29493f81-0b41-4e00-9b9a-08301cc1d2b0 could not be found. Apr 07 17:35:58.662554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Returning 404 to user: Instance 29493f81-0b41-4e00-9b9a-08301cc1d2b0 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:35:58.662554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-865918e9-9a1e-4faa-abc6-3cae8bb796c4 tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0" status: 404 len: 111 microversion: 2.1 time: 0.028204 Apr 07 17:35:58.662554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 612/1352] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:35:58 2022] GET /compute/v2.1/servers/29493f81-0b41-4e00-9b9a-08301cc1d2b0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:36:30.754551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:36:30.755189 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:36:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:36:33.932836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:33.933418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:33.940461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:33.940844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:33.941656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:33.942127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:33.966288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:36:34.220581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bf5baa01-0ad3-4a22-805c-01549f018821 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 204 len: 0 microversion: 2.1 time: 0.291306 Apr 07 17:36:34.221107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 741/1353] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:36:33 2022] DELETE /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:36:34.229096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:34.229795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:34.236710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:34.237188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:34.237966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:34.240085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:34.366842 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:34.375368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9b1025e3-03f5-4fd6-a078-8f01aded8bbb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.150135 Apr 07 17:36:34.375937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 613/1354] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:35.393096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:35.393847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:35.400431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:35.400884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:35.401675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:35.402113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:35.618669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:35.627057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f7fe7e8d-9a32-4e4b-ab58-de99e3ab960b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1736 microversion: 2.1 time: 0.238631 Apr 07 17:36:35.627649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 742/1355] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1736 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:35.861799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-2875652b-e8b5-4d74-b944-27e79d4b5050 req-0ca7dd42-2508-4500-8014-5dd89fff5eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3966d8bc-6664-4582-a275-e7dcfbcba3cc", "name": "network-vif-deleted", "tag": "47442b13-f258-4d3e-a668-6710428db8ce"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:36:35.870357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-2875652b-e8b5-4d74-b944-27e79d4b5050 req-0ca7dd42-2508-4500-8014-5dd89fff5eff service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:35.883051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-2875652b-e8b5-4d74-b944-27e79d4b5050 req-0ca7dd42-2508-4500-8014-5dd89fff5eff service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:35.883784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-2875652b-e8b5-4d74-b944-27e79d4b5050 req-0ca7dd42-2508-4500-8014-5dd89fff5eff service nova] Creating event network-vif-deleted:47442b13-f258-4d3e-a668-6710428db8ce for instance 3966d8bc-6664-4582-a275-e7dcfbcba3cc on hv-cinder-83699 Apr 07 17:36:35.889548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-2875652b-e8b5-4d74-b944-27e79d4b5050 req-0ca7dd42-2508-4500-8014-5dd89fff5eff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031962 Apr 07 17:36:35.890147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 614/1356] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:36:36.651921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:36.653829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:36.660791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:36.661260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:36.662032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:36.662463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:36.726536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:36.734856 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b7ba1abb-642f-401c-b37a-0165402e0cb3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086645 Apr 07 17:36:36.735516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 743/1357] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:37.753294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:37.753985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:37.760335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:37.760809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:37.761596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:37.762024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:37.821515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:37.829955 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-27a2ea87-aa01-4564-b997-ce99ae51b5a4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081813 Apr 07 17:36:37.830513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 615/1358] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:38.847156 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:38.847772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:38.854176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:38.854630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:38.855395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:38.855834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:38.913923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:38.921592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6a120946-18ec-4133-b7cc-c17167ada4ac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078427 Apr 07 17:36:38.922675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 744/1359] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:39.938805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:39.939415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:39.945723 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:39.946170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:39.946932 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:39.947366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:40.009408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:40.017130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c68acdb8-5540-460b-a45e-5d0f725dde20 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082179 Apr 07 17:36:40.017709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 616/1360] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:41.034268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:41.185979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:41.185979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:41.185979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:41.185979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:41.187313 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:41.324715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:41.333878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-80bc732f-4a8d-4f7f-9531-35e6c29ca6ee tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.303644 Apr 07 17:36:41.334445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 745/1361] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:42.350848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:42.351457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:42.357731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:42.358180 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:42.358939 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:42.359371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:42.420653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:42.428435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bda90b18-7bd1-493d-a348-9b6748489166 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081596 Apr 07 17:36:42.428996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 617/1362] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:43.445040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:43.445681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:43.452109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:43.452552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:43.453502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:43.453944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:43.513716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:43.521821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ba718e72-34e0-42ae-961d-d5238a29911e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080648 Apr 07 17:36:43.522395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 746/1363] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:44.538088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:44.538698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:44.545107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:44.545595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:44.546393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:44.546855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:44.604933 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:44.613432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b8a1b0d0-b803-4ac2-b50f-048eaa94e673 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079193 Apr 07 17:36:44.613993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 618/1364] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:45.629592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:45.630200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:45.636497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:45.636947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:45.637738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:45.638178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:45.700714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:45.709442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7bb9c0dc-6040-48c9-82af-9eba8153d367 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083722 Apr 07 17:36:45.710006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 747/1365] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:46.726016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:46.726621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:46.732822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:46.733295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:46.734045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:46.734611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:46.792704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:46.800648 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f0c9851f-b26f-4407-a6c7-666c2ca87f13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078484 Apr 07 17:36:46.801225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 619/1366] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:47.816701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:47.817418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:47.823719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:47.824166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:47.824926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:47.825386 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:47.883855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:47.892231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8a49be8d-fa7b-4732-8a3a-d3b59dcf5fc1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079412 Apr 07 17:36:47.892797 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 748/1367] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:48.909793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:48.910331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:48.916551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:48.917721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:48.918524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:48.919005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:48.979481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:48.988318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9cc2aaa5-4823-45da-a9c1-202bd7381efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082992 Apr 07 17:36:48.988885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 620/1368] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:50.006675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:50.007311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:50.013670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:50.014122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:50.014886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:50.015323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:50.073769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:50.081586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-562c5faa-e919-49d4-9d22-cfcc418e2fdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078732 Apr 07 17:36:50.082149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 749/1369] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:51.098319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:51.098954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:51.105185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:51.105635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:51.106392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:51.106822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:51.165364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:51.173188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e7249eb1-86eb-43d1-9857-40d7bd1669e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078768 Apr 07 17:36:51.173747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 621/1370] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:52.190068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:52.190700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:52.196902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:52.197377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:52.198134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:52.198566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:52.258906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:52.267179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0ba93153-2990-4bbc-9ed8-ff71358cdcac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081343 Apr 07 17:36:52.267745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 750/1371] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:53.284435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:53.285042 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:53.291350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:53.291803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:53.292565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:53.293004 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:53.351554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:53.359906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bdd3c517-6fc9-4c77-bf0c-04a43ffcd443 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079102 Apr 07 17:36:53.360471 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 622/1372] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:54.376777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:54.377535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:54.383848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:54.384289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:54.385049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:54.385503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:54.444149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:54.452297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-22cbef5d-06eb-4d0b-aecd-07009fbd6a9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079313 Apr 07 17:36:54.453621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 751/1373] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:55.470349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:55.470964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:55.477184 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:55.477638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:55.478400 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:55.478836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:55.538274 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:55.546007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-47bab71c-bc6c-48ff-bda8-73a3669b575e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080117 Apr 07 17:36:55.547169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 623/1374] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:56.563664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:56.564303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:56.570626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:56.571071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:56.571829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:56.572263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:56.633890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:56.641600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d8a08eb0-8ab6-4af1-aa76-f14376104b5a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081916 Apr 07 17:36:56.642174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 752/1375] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:57.658554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:57.659175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:57.665586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:57.666039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:57.666807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:57.667244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:57.777637 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:57.785793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e1f9aff4-989b-4f0c-aa4a-af2dd3550b7d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.131740 Apr 07 17:36:57.786352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 624/1376] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:36:58.803347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:58.803964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:58.810305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:58.810765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:58.811535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:58.812012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:58.870884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:58.878765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-44d4fd6c-be2e-4959-82df-13ee13a527f7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079311 Apr 07 17:36:58.879333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 753/1377] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:36:59.894966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:36:59.895576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:36:59.902139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:59.902588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:59.903396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:36:59.903893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:36:59.961771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:36:59.970157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9d528649-fba2-4318-bee8-69d84a5d2855 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079024 Apr 07 17:36:59.970719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 625/1378] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:36:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:00.987609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:00.988263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:00.994580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:00.995030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:00.995797 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:00.996239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:01.055069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:01.063287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2d7515cb-4ec4-4b04-a0b6-7fde9f839b5f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080161 Apr 07 17:37:01.063853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 754/1379] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:02.080931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:02.081673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:02.087890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:02.088335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:02.089089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:02.089544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:02.150315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:02.159151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b4a99100-356a-44b8-b1a2-112e4b563fed tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083045 Apr 07 17:37:02.159717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 626/1380] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:03.175987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:03.176598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:03.182578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:03.183063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:03.183829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:03.184270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:03.244306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:03.251116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ed5e1173-cba5-40ea-ab2f-0f67dbad2828 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079201 Apr 07 17:37:03.251675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 755/1381] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:04.268825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:04.269498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:04.275816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:04.276265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:04.277040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:04.277517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:04.372966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:04.381204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e24c09a3-a1bc-4544-8f40-c63ccb6ec09f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.117155 Apr 07 17:37:04.381773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 627/1382] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:05.398043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:05.398660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:05.404982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:05.405466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:05.406844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:05.407285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:05.465695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:05.474180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b7d57e95-db70-4290-97dc-03cd164d2816 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080298 Apr 07 17:37:05.478155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 756/1383] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:06.490318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:06.490923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:06.497120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:06.497586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:06.498335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:06.498766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:06.558102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:06.566238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-54db0911-1e96-4b67-8431-822e7a5c3168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079767 Apr 07 17:37:06.566796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 628/1384] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:07.583215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:07.583822 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:07.590209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:07.590656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:07.591418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:07.591853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:07.664861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:07.673638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-49d7ff3b-49e2-4e5c-8158-d2a49faffbe2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.094261 Apr 07 17:37:07.674217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 757/1385] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:37:08.691408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:08.692015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:08.698299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:08.698774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:08.699531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:08.699966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:08.758877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:08.766773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4c0f6a6c-e08e-4785-aafe-c9e35c0632c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079814 Apr 07 17:37:08.767326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 629/1386] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:09.784981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:09.785974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:09.794749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:09.795200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:09.795980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:09.796566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:09.860795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:09.868838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d91d30f5-7b03-478d-8e1e-3c5e72bef6ba tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.088946 Apr 07 17:37:09.869454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 758/1387] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:10.886953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:10.887548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:10.894551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:10.894999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:10.896017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:10.896450 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:10.960219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:10.967962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b9646bb5-3e13-4ee3-9975-718788f32402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084829 Apr 07 17:37:10.969145 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 630/1388] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:11.990110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:11.990724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:11.996971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:11.997449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:11.998213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:11.998651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:12.058904 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:12.066890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-36a91a1d-6e8b-4990-ae0c-ca6190428577 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080692 Apr 07 17:37:12.067461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 759/1389] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:13.083619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:13.084219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:13.091703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:13.092146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:13.092898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:13.093817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:13.152521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:13.160259 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-611231c0-414b-4654-bd12-6e900182b56d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080440 Apr 07 17:37:13.160833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 631/1390] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:14.177125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:14.177757 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:14.183997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:14.184444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:14.185236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:14.185678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:14.248278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:14.257249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6578eb71-b4c6-4639-afd4-a9e9a9d0c7da tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084021 Apr 07 17:37:14.257811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 760/1391] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:15.275405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:15.276013 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:15.282944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:15.283389 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:15.284143 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:15.284581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:15.344124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:15.351721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-df8484fd-58a8-4dde-94ff-a07818a2dc88 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080191 Apr 07 17:37:15.352281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 632/1392] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:16.369108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:16.369743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:16.376123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:16.376569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:16.377357 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:16.377794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:16.436469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:16.444666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-70db85a3-9aae-4456-ad17-2bc2717dcb28 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079402 Apr 07 17:37:16.445239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 761/1393] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:17.462582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:17.463122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:17.470055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:17.470507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:17.471272 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:17.471710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:17.532092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:17.539739 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b107a3ab-d519-4eb3-82e3-bf18a41a7579 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081136 Apr 07 17:37:17.540299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 633/1394] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:18.557672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:18.558199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:18.565029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:18.565503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:18.566264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:18.566698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:18.625338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:18.633042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-36144828-09f7-41db-9e6a-8ca473ee153a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079311 Apr 07 17:37:18.633631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 762/1395] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:19.651043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:19.651658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:19.659163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:19.659607 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:19.660365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:19.660796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:19.719747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:19.727485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5c108632-9901-4218-b0a7-6d0ff3d56822 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080388 Apr 07 17:37:19.728038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 634/1396] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:20.744976 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:20.745613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:20.752105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:20.752547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:20.753445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:20.753875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:20.815223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:20.822897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-15c74c92-acde-46d8-b717-5eb966eea59b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081760 Apr 07 17:37:20.823493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 763/1397] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:21.840220 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:21.840826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:21.847725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:21.848169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:21.848922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:21.849379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:21.908569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:21.916501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8e3c53ff-a731-4b2c-833a-3814f5b7e0d5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080112 Apr 07 17:37:21.917067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 635/1398] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:22.933804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:22.934415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:22.940869 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:22.941350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:22.942107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:22.942536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:23.000832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:23.008599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2740effa-51d8-4bb3-a0df-8e7749f4ffbf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078657 Apr 07 17:37:23.009181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 764/1399] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:24.025458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:24.026067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:24.032873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:24.033363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:24.034125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:24.034562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:24.093816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:24.101528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0d3f2057-d107-4eed-842e-7e7f3ca73fde tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079926 Apr 07 17:37:24.102097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 636/1400] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:25.119102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:25.119724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:25.126699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:25.127152 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:25.127925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:25.128370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:25.187244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:25.194997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aac02f35-4d13-4025-ba83-51458cab067f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079761 Apr 07 17:37:25.195560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 765/1401] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:26.211468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:26.212080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:26.219132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:26.219581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:26.220345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:26.220784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:26.278889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:26.288260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d8908a46-d55d-4ebe-b952-43cb3f5eb897 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080682 Apr 07 17:37:26.288829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 637/1402] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:27.306965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:27.307569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:27.314619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:27.315067 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:27.315828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:27.316263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:27.378699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:27.386455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7a225f23-7f0d-4730-afe5-81d92545b8f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083380 Apr 07 17:37:27.387028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 766/1403] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:28.402819 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:28.403432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:28.410478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:28.410922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:28.411680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:28.412117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:28.470575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:28.478344 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-936e16a3-e000-4811-bd93-ebab0b6ada56 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079371 Apr 07 17:37:28.478900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 638/1404] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:37:29.494758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:29.495298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:29.501737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:29.502190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:29.502980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:29.503418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:29.562505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:29.570405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-49dd7c0f-ab3a-47c8-a031-d83e5a897637 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079574 Apr 07 17:37:29.570980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 767/1405] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:30.588017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:30.588628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:30.595037 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:30.595488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:30.596255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:30.596695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:30.655688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:30.663819 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5cdc4e31-aed6-409a-8de9-a767177b32f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079752 Apr 07 17:37:30.664371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 639/1406] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:31.681410 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:31.682048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:31.688574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:31.689023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:31.689808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:31.690243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:31.747588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:31.755830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a04f9d8c-413e-45e4-8cbc-2c0c136f2787 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078345 Apr 07 17:37:31.756394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 768/1407] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:32.773100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:32.773734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:32.780639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:32.781086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:32.781881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:32.782320 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:32.842844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:32.850674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3b08def5-15e8-4408-a40e-3e89dfb2f398 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081707 Apr 07 17:37:32.851252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 640/1408] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:33.867329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:33.867942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:33.874910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:33.875363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:33.876125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:33.876562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:33.938380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:33.946003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6af55e11-9b76-4dc7-9766-057539fd85ea tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082547 Apr 07 17:37:33.946564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 769/1409] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:34.963908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:34.964514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:34.970490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:34.970929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:34.971682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:34.972106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:35.031878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:35.039721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-38aa37ce-3a16-49d5-af6b-fdc1a468ee3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079741 Apr 07 17:37:35.041944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 641/1410] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:36.056730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:36.057365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:36.064039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:36.064484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:36.065265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:36.065702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:36.125401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:36.133182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fba4a3a2-e0e2-4444-816f-dcb1bf17a181 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080178 Apr 07 17:37:36.133649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 770/1411] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:37.150572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:37.151185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:37.158550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:37.159001 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:37.159772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:37.160210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:37.219608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:37.227720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-255d97db-af49-4efe-9aca-950ae049d87c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081016 Apr 07 17:37:37.228290 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 642/1412] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:38.244554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:38.245222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:38.251631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:38.252077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:38.252868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:38.253335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:38.312102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:38.319850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-244e5bd4-330e-4d05-aa24-8a9e022e4ad1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079154 Apr 07 17:37:38.320416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 771/1413] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:39.336047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:39.336669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:39.343223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:39.343701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:39.344465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:39.344902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:39.403620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:39.411335 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c1d8a74b-447c-443f-830f-b95cbfe6c916 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079230 Apr 07 17:37:39.411904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 643/1414] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:40.428527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:40.429114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:40.435404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:40.436867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:40.437653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:40.438086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:40.500311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:40.508113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e96255f2-80a2-4826-a488-135483ce2e4f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083409 Apr 07 17:37:40.509224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 772/1415] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:41.526150 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:41.526669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:41.533977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:41.534419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:41.535170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:41.535602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:41.595585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:41.603257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c823c6e7-bb4b-4257-9109-7954afd4b8a7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081041 Apr 07 17:37:41.603811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 644/1416] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:42.620154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:42.620750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:42.627902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:42.628351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:42.629132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:42.629574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:42.690316 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:42.698056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6f45b92d-372d-4fab-b152-f9a026d150dd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081756 Apr 07 17:37:42.698627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 773/1417] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:43.715068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:43.715700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:43.722526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:43.722973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:43.723767 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:43.724200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:43.783125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:43.790865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-38cadc42-3fd0-4478-ad29-24b0180a4504 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079745 Apr 07 17:37:43.791425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 645/1418] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:37:44.808035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:44.808639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:44.815314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:44.815769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:44.816545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:44.816984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:44.876620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:44.884367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-98af64bf-f36e-4e34-aa54-567a99d28033 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080151 Apr 07 17:37:44.884931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 774/1419] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:45.901868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:45.902481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:45.909222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:45.909611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:45.910375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:45.910810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:45.968908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:45.976593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0448ff21-fb22-4b6b-9207-8c2bbfc46590 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078608 Apr 07 17:37:45.977167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 646/1420] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:46.992382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:46.992989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:46.999453 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:46.999906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:47.000666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:47.001103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:47.062344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:47.070038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cf2d9313-0739-4d6a-a1ce-f26d233bc400 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081533 Apr 07 17:37:47.070606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 775/1421] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:48.086786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:48.087427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:48.094423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:48.094870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:48.095638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:48.096074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:48.156431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:48.164142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-acaa086a-576e-4de4-9344-09870e6b9b50 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081258 Apr 07 17:37:48.164703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 647/1422] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:49.181530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:49.182128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:49.189559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:49.190003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:49.190764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:49.191193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:49.250528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:49.258313 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-38888f40-29b7-4c5f-b6f3-38684fb52591 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080692 Apr 07 17:37:49.258872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 776/1423] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:49.310908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:37:49.311336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:37:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:37:50.275558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:50.276166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:50.283182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:50.283628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:50.284388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:50.284825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:50.344209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:50.351986 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f1d73134-8607-4d48-9bb6-21a5d09cbffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080272 Apr 07 17:37:50.352535 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 648/1424] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:51.369613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:51.370219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:51.376791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:51.377281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:51.378045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:51.378473 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:51.436770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:51.444377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-05fe8c27-c2f5-4370-9916-8097d24dd900 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078614 Apr 07 17:37:51.444966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 777/1425] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:52.461472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:52.462082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:52.468935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:52.469397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:52.470152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:52.470583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:52.528803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:52.536642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-152bd040-104c-45d0-bc6e-b942803d0495 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079018 Apr 07 17:37:52.537221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 649/1426] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:53.553430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:53.553973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:53.559916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:53.564065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:53.564065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:53.564065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:53.623141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:53.631018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-09708137-0ccf-4c32-aefb-18fcc4afd99e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081494 Apr 07 17:37:53.631765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 778/1427] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:53.840464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:37:53.840663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:37:54.648528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:54.649152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:54.656631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:54.657077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:54.657873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:54.658308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:54.717038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:54.725593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-161449b0-5bb4-453e-ace5-f09884f6e382 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081226 Apr 07 17:37:54.726158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 650/1428] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:55.747540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:55.748146 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:55.755116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:55.755555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:55.756314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:55.756758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:55.818536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:55.826166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cbb428ea-71d9-4cde-a19d-ab29bc990b11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.087032 Apr 07 17:37:55.826719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 779/1429] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:56.843549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:56.844135 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:56.850500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:56.850944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:56.851704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:56.852136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:56.911627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:56.919382 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-082e4746-5c9f-4068-b6bf-fe3f1289223a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079935 Apr 07 17:37:56.919937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 651/1430] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:57.937385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:57.938010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:57.944150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:57.944599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:57.945385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:57.945818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:58.004847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:58.012627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1d98c96b-842e-4278-96a1-9825e11874c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079849 Apr 07 17:37:58.013209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 780/1431] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:37:59.030974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:37:59.031614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:37:59.037944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:59.038397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:59.039158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:37:59.039593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:37:59.098940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:37:59.106724 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-efbede14-9457-4c0c-85ff-981aae25650d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080167 Apr 07 17:37:59.113747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 652/1432] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:37:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:00.123756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:00.124358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:00.130677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:00.131119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:00.131872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:00.132303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:00.194188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:00.201853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2c5c23bd-b8d7-48b1-b649-710df520d439 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082124 Apr 07 17:38:00.202605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 781/1433] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:01.219534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:01.220141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:01.226422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:01.226871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:01.227630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:01.228064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:01.288469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:01.296425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-10dfe07c-d899-40e6-9052-ca4e72170369 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081388 Apr 07 17:38:01.296981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 653/1434] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:02.313408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:02.314008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:02.319865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:02.320312 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:02.321072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:02.321536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:02.380599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:02.388308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5466c45f-9fdf-4fbc-978b-36bfe8cc70d9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079175 Apr 07 17:38:02.388871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 782/1435] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:03.406233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:03.406847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:03.413105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:03.413589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:03.414357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:03.414793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:03.473481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:03.481235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-66a17481-fd46-40a4-98fa-bf17bab869a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079598 Apr 07 17:38:03.481742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 654/1436] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:04.499102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:04.499719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:04.506020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:04.506464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:04.507223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:04.507663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:04.566791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:04.574539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a4b5ab9e-7142-4d5c-96d2-18e49faa8ffa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079992 Apr 07 17:38:04.575105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 783/1437] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:05.591104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:05.591714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:05.598160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:05.603411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:05.603411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:05.603411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:05.660741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:05.668529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-518d5ef6-0b32-40c2-aea5-df685a332911 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081355 Apr 07 17:38:05.669102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 655/1438] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:06.685489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:06.687144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:06.693391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:06.693835 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:06.694592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:06.695020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:06.779247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:06.787436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8ea501c0-4643-4bc1-a47e-5b2dc268328b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.105728 Apr 07 17:38:06.788000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 784/1439] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:07.803812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:07.804420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:07.811385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:07.811838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:07.812592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:07.813023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:07.876236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:07.883913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-57dd6134-4556-45bb-9217-757ebb3ed536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084005 Apr 07 17:38:07.884461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 656/1440] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:08.900914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:08.901570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:08.908600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:08.908997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:08.909805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:08.910247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:08.970723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:08.978568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-24a3c6e6-ca0c-4062-9209-0293b23b1355 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081539 Apr 07 17:38:08.979132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 785/1441] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:09.996085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:09.996688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:10.003431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:10.003870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:10.004621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:10.005048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:10.064106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:10.071907 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ed7d946-fa46-4f9b-ad4c-566db5770a26 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079780 Apr 07 17:38:10.072469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 657/1442] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:11.089198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:11.089876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:11.097413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:11.098707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:11.098939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:11.099455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:11.178950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:11.187511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b3012d2b-e58c-414e-a6d9-5902d85265a9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.102874 Apr 07 17:38:11.188078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 786/1443] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:12.204960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:12.205583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:12.211803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:12.212245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:12.213003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:12.213468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:12.271977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:12.279647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ed425f3-8ba2-41d3-9522-4cde8a1eb23c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079124 Apr 07 17:38:12.280197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 658/1444] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:13.296146 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:13.296747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:13.303078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:13.303528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:13.304292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:13.304728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:13.365668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:13.374327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-16342776-a72d-4811-9056-f4ccb95632db tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082760 Apr 07 17:38:13.374914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 787/1445] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:14.391729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:14.392264 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:14.398763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:14.399207 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:14.399959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:14.400390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:14.459525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:14.469040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f0443736-4401-4d14-883d-eb1a5368d887 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081863 Apr 07 17:38:14.469622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 659/1446] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:15.485907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:15.486521 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:15.492747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:15.493232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:15.493994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:15.494429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:15.553423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:15.561371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3c021237-e29f-48c8-a57b-fd5e92972e68 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079394 Apr 07 17:38:15.561937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 788/1447] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:16.578660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:16.579322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:16.585638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:16.586094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:16.586860 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:16.587298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:16.647658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:16.655854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4e1d8baa-92b1-4223-a40c-5dc32642a756 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081628 Apr 07 17:38:16.656423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 660/1448] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:17.672071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:17.672682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:17.679080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:17.679528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:17.680292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:17.680729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:17.741978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:17.750032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6a77a0dd-86ee-4529-a901-fcf764c4faca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082189 Apr 07 17:38:17.750603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 789/1449] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:18.595382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:38:18.595642 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:38:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:38:18.766283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:18.766897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:18.773475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:18.773976 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:18.774753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:18.775283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:18.836485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:18.842267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-726a2e93-a84a-48ca-8de7-fda489fe664a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079148 Apr 07 17:38:18.842824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 661/1450] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:19.859413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:19.860014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:19.866587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:19.867028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:19.867786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:19.868216 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:19.927894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:19.935537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-275362eb-4fa6-479a-8425-7aaedf2f4e3e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080315 Apr 07 17:38:19.936105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 790/1451] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:20.952328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:20.952938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:20.959231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:20.959685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:20.960451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:20.960892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:21.019530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:21.027545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dcf2d52e-3d5e-4e34-acc4-5c987ad77771 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079116 Apr 07 17:38:21.028112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 662/1452] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:22.045605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:22.046219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:22.052540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:22.052992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:22.053779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:22.054219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:22.119052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:22.127129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b66a6139-5fb2-441d-8b22-4773994a6411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.085841 Apr 07 17:38:22.127801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 791/1453] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:23.144233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:23.145089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:23.151302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:23.151746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:23.152498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:23.152929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:23.211804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:23.219543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a3fd540a-851d-487a-8e33-25969bcc3209 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079116 Apr 07 17:38:23.220098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 663/1454] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:24.236806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:24.237442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:24.243735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:24.244180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:24.244938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:24.245402 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:24.309569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:24.317523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b503395e-74f1-400e-adc1-4c915650d5a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084508 Apr 07 17:38:24.318083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 792/1455] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:25.334454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:25.335060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:25.341438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:25.341884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:25.342639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:25.343074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:25.402453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:25.410560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9c8640fd-9867-426b-8258-b30049aa8f8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079962 Apr 07 17:38:25.411118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 664/1456] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:26.427723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:26.428397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:26.434613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:26.435760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:26.436396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:26.436833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:26.655684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:26.663456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-84fe6fb0-ed17-4c6a-afc9-39d0a15c056f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.239553 Apr 07 17:38:26.664010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 793/1457] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:27.679813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:27.680427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:27.687540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:27.687990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:27.688759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:27.689238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:27.750430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:27.760122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8fd9f047-e78d-49e7-920d-cf74950d61af tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083997 Apr 07 17:38:27.760944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 665/1458] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:28.779982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:28.780596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:28.786876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:28.787321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:28.788077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:28.788510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:28.847115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:28.854708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1050bd19-37f8-4cb4-a542-1f4da55424cf tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078631 Apr 07 17:38:28.855248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 794/1459] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:29.873312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:29.873930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:29.880385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:29.880841 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:29.881643 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:29.882085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:29.940805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:29.948517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-98ea61ca-9588-40bb-b08a-a1d7d308517c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079907 Apr 07 17:38:29.949074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 666/1460] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:30.965264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:30.966006 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:30.972463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:30.972912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:30.973711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:30.974151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:31.035050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:31.042809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-32fcd022-dc7f-4ce3-a763-e879aaa7dcfd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081351 Apr 07 17:38:31.043362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 795/1461] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:32.060251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:32.060848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:32.067130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:32.067578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:32.068333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:32.068762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:32.128532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:32.136136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c899703b-9dd3-41eb-85ac-b08e6b52e38d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079910 Apr 07 17:38:32.136691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 667/1462] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:33.154605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:33.155203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:33.160981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:33.161471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:33.162229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:33.162662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:33.222197 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:33.230042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c371a911-b643-40fb-84fb-81b24d6294cc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080534 Apr 07 17:38:33.230590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 796/1463] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:34.247540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:34.248130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:34.254284 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:34.254728 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:34.255485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:34.255923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:34.315422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:34.322962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e549546b-dd11-4143-880c-c37c3823249a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079489 Apr 07 17:38:34.323519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 668/1464] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:35.339640 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:35.340096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:35.346991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:35.347441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:35.348206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:35.348639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:35.408789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:35.416826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1af939a8-5e9b-4c6d-a2ae-a9393cc638d7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080981 Apr 07 17:38:35.426216 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 797/1465] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:38:36.433691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:36.435034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:36.441309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:36.441763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:36.442526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:36.442967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:36.501795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:36.509639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1e78fa45-f5c2-4852-9b65-6a30e911d402 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079875 Apr 07 17:38:36.510193 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 669/1466] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:37.526543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:37.527156 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:37.534005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:37.534456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:37.535221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:37.535661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:37.596981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:37.604721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-786e4610-4b8f-4e06-8d99-e93542c6a5ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082017 Apr 07 17:38:37.605303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 798/1467] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:38.621336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:38.622542 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:38.628775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:38.629359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:38.630130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:38.630564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:38.692497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:38.701012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-598cefda-c2be-420a-ae9e-76e23e4cc935 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083093 Apr 07 17:38:38.701605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 670/1468] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:39.718057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:39.718660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:39.724872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:39.725350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:39.726118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:39.726553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:39.786436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:39.794142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-229849d4-5c97-4293-b716-bec9b920109e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080209 Apr 07 17:38:39.794687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 799/1469] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:40.811469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:40.812074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:40.818398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:40.818837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:40.819591 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:40.820023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:40.878849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:40.886479 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-61536dda-d4d4-40fb-9f55-dbcc39eacf2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079591 Apr 07 17:38:40.887049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 671/1470] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:41.904428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:41.904952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:41.911260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:41.911715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:41.912484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:41.912927 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:41.971202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:41.978906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-292c0f4e-fb21-4d1c-a7d7-60b277d3f291 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078983 Apr 07 17:38:41.979458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 800/1471] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:42.995310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:42.995924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:43.003295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:43.003736 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:43.004497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:43.004927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:43.065030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:43.072847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-387a391b-8403-48c6-9d96-0ef6c5e16df4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081393 Apr 07 17:38:43.073436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 672/1472] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:44.089836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:44.091071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:44.097342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:44.097806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:44.098578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:44.099021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:44.160442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:44.168177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-74bd4008-ce79-4664-884f-43974cd45685 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082191 Apr 07 17:38:44.168878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 801/1473] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:45.185626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:45.186296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:45.192444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:45.192894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:45.193684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:45.194119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:45.252170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:45.259943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-100e9e9b-e23a-48e2-9c4d-3707a5611198 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078801 Apr 07 17:38:45.260503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 673/1474] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:46.277568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:46.278254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:46.284433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:46.284881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:46.285671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:46.286110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:46.344596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:46.352478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3c616eac-521d-48fa-9d42-d8ab67868c75 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078768 Apr 07 17:38:46.353031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 802/1475] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:47.369866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:47.370473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:47.377703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:47.378148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:47.378898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:47.379328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:47.439771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:47.447416 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8b0351f8-c47f-4620-b0b4-9a3d42bd6791 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081477 Apr 07 17:38:47.447979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 674/1476] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:48.464766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:48.465844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:48.471656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:48.472108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:48.472872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:48.473346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:48.531836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:48.539513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6f4cec25-c91c-4fdf-94f2-e0e5e7326f09 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078621 Apr 07 17:38:48.540065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 803/1477] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:49.556768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:49.557395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:49.564540 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:49.564981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:49.565762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:49.566192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:49.625211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:49.632793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0031fefc-59bb-4df0-8430-0354547fe575 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079927 Apr 07 17:38:49.633375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 675/1478] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:50.650408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:50.651023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:50.658346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:50.658803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:50.659569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:50.660008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:50.720659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:50.728359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d0b09b8e-819f-4932-9708-dd7923140fd3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081803 Apr 07 17:38:50.728911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 804/1479] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:51.744493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:51.745096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:51.751991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:51.752433 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:51.753202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:51.753632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:51.812834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:51.820720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c582e040-2311-40bf-979d-bb4d239dc00b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080041 Apr 07 17:38:51.821302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 676/1480] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:52.837424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:52.838041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:52.844543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:52.844996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:52.845799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:52.846235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:52.906873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:52.915367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cb24f65e-e950-4822-a133-ce0f5887afc2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081819 Apr 07 17:38:52.915925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 805/1481] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:53.932488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:53.933101 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:53.940096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:53.940543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:53.941329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:53.941762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:54.000472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:54.008093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ad07044f-ab05-4e20-9a53-730ca87c6a99 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079504 Apr 07 17:38:54.008654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 677/1482] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:55.025929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:55.031886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:55.032796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:55.033287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:55.034058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:55.034497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:55.093389 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:55.101256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-22b84cbc-ff09-4b7d-b74a-023f24b0ba01 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079236 Apr 07 17:38:55.101819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 806/1483] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:56.118466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:56.119083 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:56.125845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:56.126289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:56.127046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:56.127516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:56.186490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:56.194221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d870c829-0329-4b57-91b3-3d91aa09e69c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079597 Apr 07 17:38:56.194789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 678/1484] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:57.211743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:57.212357 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:57.218673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:57.219124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:57.219892 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:57.220332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:57.282366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:57.290229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-30830b8b-589b-4dd8-98cd-b31105e98c6a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082351 Apr 07 17:38:57.290806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 807/1485] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:58.307446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:58.308058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:58.314938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:58.315392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:58.316153 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:58.316591 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:58.374866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:58.382572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-530512e4-1da7-4839-8ed3-50110f88da2c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078982 Apr 07 17:38:58.383134 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 679/1486] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:38:59.399859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:38:59.400470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:38:59.406596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:59.407044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:59.407804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:38:59.408241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:38:59.466538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:38:59.474297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0952f72c-219c-480c-b2b0-6d907b339b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078279 Apr 07 17:38:59.474855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 808/1487] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:38:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:00.491873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:00.492496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:00.499116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:00.499565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:00.500334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:00.500786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:00.561565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:00.571136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f798de1e-ef1a-4af4-9358-b23a449ab758 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083196 Apr 07 17:39:00.571712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 680/1488] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:01.588467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:01.588999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:01.595541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:01.595983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:01.596733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:01.597180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:01.655403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:01.663185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c4a271e5-2b84-48bc-b44f-54a16d0e3a03 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078632 Apr 07 17:39:01.663737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 809/1489] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:02.680400 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:02.681005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:02.688555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:02.689005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:02.689784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:02.690212 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:02.748197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:02.755996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c73c9bf0-c82f-48da-9d79-f8e4249d6171 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079398 Apr 07 17:39:02.756871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 681/1490] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:03.773080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:03.773719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:03.780659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:03.781112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:03.781909 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:03.782352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:03.844019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:03.851894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fc2d79b6-9aa2-444b-999a-38991ad37263 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083059 Apr 07 17:39:03.852459 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 810/1491] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:04.869213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:04.869739 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:04.875958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:04.876408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:04.877196 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:04.877642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:04.935858 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:04.943651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b3ea3aa2-ba49-4939-9695-e89bef965774 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078440 Apr 07 17:39:04.944219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 682/1492] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:05.961108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:05.961762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:05.968919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:05.969413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:05.970223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:05.970688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:06.057098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:06.065456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e2f75531-167e-4e57-b19c-f90c09a0b6a8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.108217 Apr 07 17:39:06.066033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 811/1493] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:07.083275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:07.083882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:07.090194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:07.090647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:07.091418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:07.091854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:07.151168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:07.158938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-117b2a5d-9671-4143-8695-dafa7bd8e6c3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079525 Apr 07 17:39:07.159505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 683/1494] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:08.176595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:08.177233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:08.183467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:08.183915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:08.184682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:08.185126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:08.245603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:08.253261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a5372c24-1943-406a-86c5-29a94245de48 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080541 Apr 07 17:39:08.253823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 812/1495] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:09.270379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:09.270985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:09.278408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:09.278848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:09.279603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:09.280033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:09.342942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:09.350725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9a19ec4e-c7df-4f2b-8de8-3ba4390857ca tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084536 Apr 07 17:39:09.351283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 684/1496] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:10.367841 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:10.368455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:10.375499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:10.375955 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:10.376726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:10.377195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:10.435343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:10.443103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-72fc77fd-4d04-4a43-bc31-e2b992919cdd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079143 Apr 07 17:39:10.443663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 813/1497] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:11.459786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:11.460429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:11.466992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:11.467452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:11.468221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:11.468657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:11.526881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:11.534522 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-19584a97-79d9-4262-9eeb-74991c4885a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078612 Apr 07 17:39:11.535086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 685/1498] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:12.551888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:12.552497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:12.558951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:12.559401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:12.560167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:12.560621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:12.618911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:12.626790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f77091ba-959b-4433-8a37-eb7f9458addc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078825 Apr 07 17:39:12.627347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 814/1499] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:13.643834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:13.644684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:13.651817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:13.652289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:13.653071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:13.653672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:13.712423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:13.720797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dcc505e3-2263-47a7-9de7-fb270c4ab769 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080928 Apr 07 17:39:13.721390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 686/1500] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:14.738516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:14.739129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:14.746060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:14.746506 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:14.747267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:14.747705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:14.805199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:14.813756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7ba4fc86-bd01-40a9-9367-12ab41a399f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079132 Apr 07 17:39:14.814318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 815/1501] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:15.830442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:15.831053 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:15.837332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:15.837781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:15.838550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:15.839140 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:15.903538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:15.911762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-938a0140-d871-43c0-9a30-317a54e7f223 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.085079 Apr 07 17:39:15.912460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 687/1502] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:39:16.928415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:16.929017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:16.935823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:16.936265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:16.937016 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:16.937476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:16.996404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:17.004113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ece460fd-f187-4b22-bf20-b5021abfd147 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079591 Apr 07 17:39:17.004671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 816/1503] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:18.021302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:18.021943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:18.028204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:18.028655 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:18.029436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:18.029872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:18.089336 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:18.097345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4fe6a117-c30a-46fa-9e89-2e11b528aa8c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080179 Apr 07 17:39:18.097900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 688/1504] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:19.115109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:19.115918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:19.122497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:19.122945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:19.123708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:19.124144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:19.185286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:19.193102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9385b4ea-0c98-42bb-960f-086c9281d124 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082096 Apr 07 17:39:19.196053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 817/1505] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:20.210495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:20.211111 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:20.217945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:20.218391 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:20.219154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:20.219592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:20.278221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:20.285807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-43c71359-d3f9-42ed-a64b-d566567021e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079161 Apr 07 17:39:20.286367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 689/1506] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:21.303213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:21.303827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:21.311252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:21.311694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:21.312448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:21.312887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:21.371298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:21.379107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5af9d672-60c3-4052-bd38-1677e302e77a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079782 Apr 07 17:39:21.379661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 818/1507] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:22.395603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:22.396217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:22.403257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:22.403739 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:22.404520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:22.404957 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:22.465755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:22.473493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3a5bdf26-0bf0-4c1b-9a9e-38fc7df16c72 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082014 Apr 07 17:39:22.474059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 690/1508] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:23.490533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:23.491166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:23.497652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:23.498098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:23.498852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:23.499282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:23.558520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:23.566370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9f4ae541-4d4b-4564-8465-1ed2e546b7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079699 Apr 07 17:39:23.566934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 819/1509] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:24.583722 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:24.584363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:24.591496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:24.591946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:24.592707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:24.593171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:24.652020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:24.659827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c57ac2eb-4a8b-4fab-9554-29652abd4bbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079931 Apr 07 17:39:24.660384 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 691/1510] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:25.676861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:25.677507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:25.684452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:25.686141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:25.686141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:25.686141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:25.745557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:25.753359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3720a096-4e1c-4690-a2aa-2391de0eb262 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080410 Apr 07 17:39:25.753931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 820/1511] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:26.771150 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:26.771754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:26.778215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:26.778662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:26.779421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:26.779853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:26.843077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:26.850873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8383d005-730a-4fca-a5d0-3adf20403411 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083914 Apr 07 17:39:26.851434 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 692/1512] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:27.867577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:27.868181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:27.874917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:27.875362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:27.876111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:27.876541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:27.936152 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:27.943774 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5b23b501-798f-4e82-bbd9-759796ea567d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080043 Apr 07 17:39:27.944329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 821/1513] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:28.960355 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:28.960964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:28.967893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:28.968337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:28.969093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:28.969615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:29.031186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:29.038955 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e53f380a-c301-40db-b434-efac748d4a0f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082389 Apr 07 17:39:29.039452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 693/1514] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:30.057356 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:30.057988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:30.064283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:30.064731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:30.065532 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:30.065972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:30.124388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:30.132065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-20f65e82-9bd0-4a65-98c4-6c55b7c61008 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079251 Apr 07 17:39:30.132629 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 822/1515] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:31.149752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:31.150347 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:31.156751 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:31.157221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:31.158010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:31.158438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:31.219253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:31.226918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c0e86c57-73b4-42f5-a1a8-8932a211daac tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081155 Apr 07 17:39:31.227483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 694/1516] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:32.243921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:32.245028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:32.250861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:32.251304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:32.252055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:32.252485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:32.311679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:32.319330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-13b3ca83-24ed-4f1c-afdf-ee088d822b17 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079450 Apr 07 17:39:32.319885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 823/1517] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:33.336059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:33.336674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:33.343114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:33.343571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:33.344338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:33.344776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:33.403580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:33.411331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-276bc534-6a5b-4daf-b144-e5f6046c7eeb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079141 Apr 07 17:39:33.411897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 695/1518] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:34.427789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:34.434597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:34.435350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:34.435807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:34.436579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:34.437028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:34.495692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:34.503394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5ef91913-4eac-4976-9a4c-9a590bd92be9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079569 Apr 07 17:39:34.503958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 824/1519] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:35.521236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:35.521853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:35.527808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:35.528257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:35.529019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:35.529477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:35.589415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:35.597199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4b33a515-d379-4f4d-bcda-d5c456b037d8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080165 Apr 07 17:39:35.597714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 696/1520] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:36.614321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:36.614918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:36.621502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:36.621959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:36.622724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:36.623164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:36.683743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:36.691563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0b43814b-0d31-42d7-a5e1-cb56ba6f15cb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081107 Apr 07 17:39:36.692133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 825/1521] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:37.709381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:37.709988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:37.717333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:37.717778 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:37.718529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:37.718959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:37.779373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:37.787029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a3b4a64a-60af-429e-9502-d9130e443552 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081556 Apr 07 17:39:37.787586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 697/1522] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:38.803862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:38.804472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:38.811947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:38.812393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:38.816445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:38.816445 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:38.873839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:38.881454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d9a9ef3d-1098-4bf7-a3c4-a81c715a81fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081461 Apr 07 17:39:38.882009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 826/1523] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:39.898874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:39.899492 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:39.906434 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:39.906824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:39.907583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:39.908017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:39.966283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:39.974152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-727808e5-0868-4833-aa2b-9a388194bf9c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079125 Apr 07 17:39:39.974716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 698/1524] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:40.991527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:40.992138 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:40.998975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:40.999422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:41.000182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:41.000613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:41.059089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:41.071214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0ffeba8b-20bc-4aea-8cb2-914c7db0a08a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083525 Apr 07 17:39:41.071790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 827/1525] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:42.088760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:42.089390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:42.095620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:42.096064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:42.096816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:42.097288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:42.158899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:42.166768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-de6096d8-76ed-43cd-81eb-8c6fb3d5d81d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082287 Apr 07 17:39:42.167331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 699/1526] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:43.183537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:43.184143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:43.190469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:43.190914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:43.191670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:43.192104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:43.251040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:43.258711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-680903f6-69f8-49b9-94f8-49c2b6fc6324 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079068 Apr 07 17:39:43.259832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 828/1527] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:44.276640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:44.277266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:44.283494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:44.283935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:44.284687 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:44.285116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:44.344641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:44.352213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5999b099-ec40-491d-9f0c-7f4373dd7b22 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080015 Apr 07 17:39:44.352769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 700/1528] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:45.369415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:45.370024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:45.377050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:45.377532 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:45.378293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:45.378728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:45.437451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:45.445342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5ec91488-653d-46b5-b548-bc8a0cdbf692 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079916 Apr 07 17:39:45.445912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 829/1529] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:46.464252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:46.464847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:46.471343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:46.471798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:46.472563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:46.472998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:46.533971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:46.541678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b571fa27-4607-4040-bd08-64e91107cf64 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083576 Apr 07 17:39:46.542244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 701/1530] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:47.558587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:47.559203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:47.565509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:47.565963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:47.566732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:47.567173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:47.625000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:47.632701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-96be8645-3915-45cb-ad68-b5f082a33fb9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078178 Apr 07 17:39:47.633290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 830/1531] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:48.651229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:48.651874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:48.658142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:48.658585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:48.659343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:48.659771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:48.722512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:48.730995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-74d3e698-3cbf-4d51-9b8c-27bc74ab2b31 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084594 Apr 07 17:39:48.731555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 702/1532] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:49.748276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:49.748891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:49.755206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:49.755661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:49.756427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:49.756870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:49.816735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:49.824592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cb415d52-0aa3-4e9f-a0bd-e26a61590854 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080336 Apr 07 17:39:49.825173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 831/1533] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:50.762785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:39:50.763275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:39:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:39:50.841591 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:50.842234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:50.848494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:50.848944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:50.849735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:50.850175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:50.910957 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:50.918870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a6f854f3-05c7-449f-bb01-d4cdbd6e619c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081633 Apr 07 17:39:50.919429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 703/1534] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:51.935834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:51.936444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:51.942747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:51.943190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:51.943948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:51.944378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:52.004162 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:52.012429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-67d02a32-20fb-475f-aa55-4a2edc86a838 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080707 Apr 07 17:39:52.012984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 832/1535] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:53.030309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:53.030917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:53.037353 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:53.037799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:53.038554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:53.038993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:53.098609 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:53.106361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5421371a-138e-4442-af36-a99872f43efd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079964 Apr 07 17:39:53.106935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 704/1536] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:39:54.123994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:54.124611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:54.131103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:54.131547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:54.132302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:54.132732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:54.190674 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:54.198833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dd9f7ff2-1e6f-493c-a1b4-9ff32f967d34 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078694 Apr 07 17:39:54.199394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 833/1537] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:39:55.216272 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:55.216879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:55.223365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:55.223815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:55.224574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:55.225009 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:55.288155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:55.295941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-df82cba8-8e40-420e-bc15-bb94323f7f2d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084140 Apr 07 17:39:55.296528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 705/1538] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:56.313251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:56.313867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:56.320137 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:56.320589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:56.321385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:56.321823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:56.380217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:56.387931 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c1429d74-bb2c-4cf3-ab1f-1ff81f659c37 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078535 Apr 07 17:39:56.388496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 834/1539] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:57.405062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:57.405711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:57.412030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:57.412483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:57.413295 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:57.413734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:57.472025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:57.480262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0a6c582a-8a48-496c-8d57-b31f052ffe25 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079027 Apr 07 17:39:57.480826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 706/1540] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:58.497255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:58.497828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:58.504149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:58.504595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:58.505394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:58.505832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:58.607213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:58.614969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-487d208e-8fb1-4696-8621-154e7b223b86 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.122163 Apr 07 17:39:58.615530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 835/1541] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:39:59.632068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:39:59.632592 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:39:59.638945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:59.639389 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:59.640171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:39:59.640605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:39:59.702785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:39:59.710365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9dbdc556-bb70-4cc2-8cf4-2895a4aba5fe tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082221 Apr 07 17:39:59.710917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 707/1542] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:39:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:00.727273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:00.727885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:00.734179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:00.734634 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:00.735396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:00.735834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:00.801355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:00.810283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-638fd575-4f7b-4066-9e27-a8d1c1bf9af1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086982 Apr 07 17:40:00.811090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 836/1543] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:01.827543 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:01.828118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:01.834428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:01.834873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:01.835626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:01.836055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:01.897000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:01.905831 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6c7c67a3-f450-4d55-ab04-f622769ac948 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082011 Apr 07 17:40:01.906347 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 708/1544] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:02.922552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:02.923172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:02.929302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:02.929763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:02.930656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:02.931101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:02.989184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:02.997063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-573d3920-018b-48ce-9794-420d50a2f95e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078557 Apr 07 17:40:02.997667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 837/1545] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:04.013465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:04.014127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:04.020646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:04.021100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:04.021894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:04.022334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:04.080734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:04.089322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b109e644-9c70-4132-b612-217591c2ee11 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079649 Apr 07 17:40:04.089891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 709/1546] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:05.105889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:05.106511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:05.112832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:05.116545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:05.116545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:05.116545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:05.174220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:05.182306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-877dcaf7-f0d4-47ca-b2c5-2f102fdedc15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080702 Apr 07 17:40:05.182818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 838/1547] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:06.199354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:06.199988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:06.205967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:06.206477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:06.207254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:06.207693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:06.268060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:06.276214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-359359e7-30b3-4461-a916-ddfc87504df6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081441 Apr 07 17:40:06.276776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 710/1548] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:07.292988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:07.293636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:07.299963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:07.300414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:07.301209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:07.301653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:07.363405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:07.372131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9673ae80-4903-42dc-b1da-d866f0c2ce1b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083039 Apr 07 17:40:07.372700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 839/1549] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:08.389589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:08.390195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:08.396781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:08.397265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:08.398026 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:08.398457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:08.461625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:08.469552 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bb1def37-5e26-4828-948e-95d7c1952a8a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083808 Apr 07 17:40:08.470128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 711/1550] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:09.486303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:09.486837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:09.493724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:09.494174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:09.494930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:09.495367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:09.552449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:09.560834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c7f9374c-7c97-42b9-9b1b-c5268116c434 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078435 Apr 07 17:40:09.561438 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 840/1551] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:10.577541 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:10.578124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:10.584322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:10.584765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:10.585542 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:10.586689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:10.664944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:10.672900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d9d52dc1-510b-4d78-8b15-343d84b19ce2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.099221 Apr 07 17:40:10.673504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 712/1552] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:11.689618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:11.690226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:11.696743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:11.697204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:11.697980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:11.698460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:11.758168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:11.765912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6a1a46fb-9d13-469e-ac18-1cd91ab06bf5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080194 Apr 07 17:40:11.766480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 841/1553] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:12.782841 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:12.783452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:12.789810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:12.790254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:12.791014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:12.791449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:12.849415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:12.857266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5a7c3a22-23b8-43a0-a09a-2a093b21bcff tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078228 Apr 07 17:40:12.857832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 713/1554] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:13.873995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:13.874600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:13.880871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:13.881365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:13.882161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:13.882601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:13.943315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:13.951519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-05f333e4-3ff5-4594-b9cd-cc5e501ce42c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081431 Apr 07 17:40:13.952085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 842/1555] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:14.969000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:14.969638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:14.975956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:14.976417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:14.978494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:14.978933 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:15.040232 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:15.047991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5299c00c-63c7-4c41-b047-439cfb8e95f3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082958 Apr 07 17:40:15.048549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 714/1556] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:16.063920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:16.064502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:16.071946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:16.072151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:16.072781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:16.073284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:16.130722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:16.139209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bd03cf7f-1f05-4196-a772-9b8121cea28d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079164 Apr 07 17:40:16.139771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 843/1557] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:17.156158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:17.156761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:17.163005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:17.163451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:17.164202 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:17.165267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:17.222547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:17.231007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c3e78eb0-0fb5-460d-bd15-7f4bf19f85c7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078864 Apr 07 17:40:17.231573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 715/1558] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:18.248297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:18.248905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:18.255210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:18.255659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:18.256417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:18.256853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:18.316428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:18.324334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3edc3922-c280-4e89-b609-e394c30c2b9a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079969 Apr 07 17:40:18.324900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 844/1559] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:19.341795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:19.342403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:19.348630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:19.349075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:19.349929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:19.350294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:19.409714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:19.417608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d049f1c2-6cb6-436d-8d3f-99a40505104b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079671 Apr 07 17:40:19.418174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 716/1560] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:20.434620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:20.435233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:20.441606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:20.442059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:20.442830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:20.443269 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:20.504578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:20.513281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-117026f4-a156-4818-8f44-1c7ba95a4170 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082734 Apr 07 17:40:20.513849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 845/1561] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:21.530616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:21.531251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:21.537569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:21.538015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:21.538777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:21.539214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:21.597862 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:21.606149 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d8cb18ba-cc7a-44f5-a141-aeb99852aac8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079363 Apr 07 17:40:21.606719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 717/1562] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:22.623174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:22.623786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:22.630123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:22.630571 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:22.631335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:22.631803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:22.692944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:22.701636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8c8429bd-7e24-4061-8a94-4c6d4aeda51b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082285 Apr 07 17:40:22.702208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 846/1563] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:23.718204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:23.718812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:23.729911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:23.730370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:23.731138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:23.731574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:23.791364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:23.799144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-934f4e61-473f-4f96-9b42-93b4712439f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084904 Apr 07 17:40:23.799706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 718/1564] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:24.816654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:24.817291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:24.823727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:24.824176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:24.824951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:24.825416 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:24.883716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:24.891428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-99910a96-f104-4237-9cf0-298364c1c92d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078641 Apr 07 17:40:24.892905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 847/1565] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:25.909378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:25.909937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:25.916157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:25.917663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:25.918114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:25.918546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:25.976990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:25.985303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3362512b-a087-4bdc-b3f7-26e54ef23fd8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079914 Apr 07 17:40:25.985859 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 719/1566] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:27.002874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:27.003518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:27.009815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:27.010415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:27.011232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:27.011671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:27.073861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:27.081823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f4373beb-4245-4c21-bbb5-452876074425 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082773 Apr 07 17:40:27.082393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 848/1567] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:28.099256 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:28.099868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:28.106871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:28.107318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:28.108101 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:28.108523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:28.168299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:28.176229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b1ad482b-85ab-4d11-adb3-29d095e8b22d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080806 Apr 07 17:40:28.176793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 720/1568] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:29.193528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:29.194142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:29.201096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:29.201572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:29.202335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:29.202771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:29.262941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:29.271123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9e67b2ab-43ab-434f-8988-7839e516b690 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081416 Apr 07 17:40:29.271711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 849/1569] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:30.287751 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:30.288340 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:30.295000 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:30.295449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:30.296197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:30.296623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:30.357438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:30.364998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-34a3d5f9-77fd-4988-b984-1e10628697e2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081150 Apr 07 17:40:30.365598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 721/1570] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:31.381455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:31.382074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:31.388119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:31.388565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:31.389369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:31.389806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:31.457133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:31.465646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-784c424c-3859-47e7-82d4-e870d8efc1f4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.088067 Apr 07 17:40:31.466212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 850/1571] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:32.482782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:32.483394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:32.489657 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:32.490095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:32.490848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:32.491277 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:32.550560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:32.558713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dcf9dc58-8ef5-4bee-9d63-2f28fac5bef5 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080245 Apr 07 17:40:32.559273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 722/1572] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:33.578925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:33.578925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:33.582660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:33.583110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:33.583876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:33.584315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:33.646275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:33.654871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0b76bd7f-b5b2-4312-92bd-d292283ef354 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083053 Apr 07 17:40:33.655443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 851/1573] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:34.672285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:34.672921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:34.679031 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:34.679475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:34.680235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:34.680666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:34.739460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:34.747363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1d633fdc-bfd4-4e00-9a33-63bceeb09e6f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079094 Apr 07 17:40:34.747923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 723/1574] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:35.756089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:35.756658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:35.763860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.764689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.764815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:35.765310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.765577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:35.765752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.772768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.773374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.774296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.774833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.785972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] HTTP exception thrown: Instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 could not be found. Apr 07 17:40:35.786605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Returning 404 to user: Instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:40:35.787428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-688a54d1-11f7-4bf3-aa05-51ff67c6e155 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "DELETE /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 404 len: 111 microversion: 2.20 time: 0.035383 Apr 07 17:40:35.788065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 852/1575] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Apr 7 17:40:35 2022] DELETE /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:40:35.793130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:35.794275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:35.800794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.801282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.802258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.802700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.818276 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] HTTP exception thrown: Instance 19ffd683-613d-4c1a-9df2-0250be28226e could not be found. Apr 07 17:40:35.818824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Returning 404 to user: Instance 19ffd683-613d-4c1a-9df2-0250be28226e could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:40:35.819662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9b25fc22-9fa9-46be-a539-be44a81d4819 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 404 len: 111 microversion: 2.1 time: 0.030702 Apr 07 17:40:35.822176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 853/1576] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:40:35 2022] DELETE /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:40:35.828620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:35.829946 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:35.836979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.837604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.838458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.838899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.844230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:35.852888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-89674a5e-c9c2-4220-b2d1-e1ccf1bf39f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.092943 Apr 07 17:40:35.853518 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 724/1577] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:35 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:35.854933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] HTTP exception thrown: Instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 could not be found. Apr 07 17:40:35.855848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Returning 404 to user: Instance 32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:40:35.856689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-81050490-ebc9-4351-a490-42cce8e4264f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06" status: 404 len: 111 microversion: 2.20 time: 0.035583 Apr 07 17:40:35.857524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 854/1578] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:40:35 2022] GET /compute/v2.1/servers/32c7b4e2-d9d7-4c44-a073-1b0b2ef4bd06 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:40:35.861710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:35.861993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:35.862329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: 19ffd683-613d-4c1a-9df2-0250be28226e] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:35.862480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:35.868319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.868488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.868764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.869662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.870237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.870454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:35.870778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.870902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:35.884007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] HTTP exception thrown: Instance 19ffd683-613d-4c1a-9df2-0250be28226e could not be found. Apr 07 17:40:35.884630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Returning 404 to user: Instance 19ffd683-613d-4c1a-9df2-0250be28226e could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:40:35.885663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b695f37d-eb42-4251-a660-b84ce89c1b24 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e" status: 404 len: 111 microversion: 2.1 time: 0.031082 Apr 07 17:40:35.886197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 725/1579] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:35 2022] GET /compute/v2.1/servers/19ffd683-613d-4c1a-9df2-0250be28226e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:40:35.894541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:40:36.156116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d3053f41-0108-4e02-ae29-ed67ffaa0940 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 204 len: 0 microversion: 2.1 time: 0.297284 Apr 07 17:40:36.156625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 855/1580] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:40:35 2022] DELETE /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:40:36.164892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:36.165562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:36.171979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:36.172429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:36.173214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:36.173651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:36.313046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:36.321487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e77dfabf-0766-4806-8f4d-bda8349e15d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.160401 Apr 07 17:40:36.324561 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 726/1581] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:36 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:36.871012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:36.871750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:36.878053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:36.878510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:36.879272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:36.879702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:36.943433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:36.952147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-640a09d4-472c-4ce0-ae78-1f957dd72c59 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.085679 Apr 07 17:40:36.952704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 856/1582] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:37.340791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:37.341430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:37.347847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:37.348301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:37.349064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:37.349532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:37.477974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:37.485992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9b916892-b50e-4472-8623-0050588ca520 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149234 Apr 07 17:40:37.486552 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 727/1583] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:37 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:37.967982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:37.968594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:37.974929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:37.975384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:37.976149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:37.976588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:38.035145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:38.043970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-099be071-f901-4e19-bf6b-0600bd4b5cc6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079835 Apr 07 17:40:38.044533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 857/1584] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:38.503747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:38.504289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:38.510809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:38.511262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:38.512035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:38.512477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:38.646271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:38.654961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-40ae974a-5c07-40be-a2d4-541b799e53e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155227 Apr 07 17:40:38.655536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 728/1585] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:38 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:39.060902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:39.061538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:39.068115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:39.068565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:39.069368 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:39.069810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:39.129072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:39.136814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4128c508-e549-4a6a-a066-4971c535a5e9 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080095 Apr 07 17:40:39.139361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 858/1586] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:39.671845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:39.672470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:39.678904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:39.679355 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:39.680118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:39.680555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:39.813947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:39.821645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6c239537-638c-4b95-afcd-476317f89305 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153660 Apr 07 17:40:39.823106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 729/1587] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:39 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:40.154051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:40.154660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:40.160936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:40.161412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:40.162175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:40.162613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:40.222022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:40.230449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1c7bdd0a-ed62-4a56-8620-d4321f12a78e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080386 Apr 07 17:40:40.231005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 859/1588] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:40.839729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:40.840368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:40.846715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:40.847168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:40.847930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:40.848363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:40.982931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:40.990688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3a4ff742-f7f0-4f9c-921a-4b06b7f3a42c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155157 Apr 07 17:40:40.991244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 730/1589] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:40 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:41.247326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:41.247863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:41.254127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:41.254579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:41.255339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:41.255777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:41.317019 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:41.324872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7177a10d-833a-4866-9222-ef8b70d61c30 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081603 Apr 07 17:40:41.325459 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 860/1590] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:42.008439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:42.009053 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:42.015374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:42.015821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:42.016581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:42.017014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:42.148973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:42.157269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-891613bc-7938-4fbb-9a15-3460abb6adb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152642 Apr 07 17:40:42.157829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 731/1591] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:42 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:42.342040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:42.342561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:42.348736 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:42.349209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:42.349967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:42.350397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:42.409878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:42.418636 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-89840cc9-b344-475e-9470-27205b040931 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080962 Apr 07 17:40:42.419188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 861/1592] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:43.174730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:43.175369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:43.182414 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:43.182866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:43.183626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:43.184059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:43.317444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:43.325943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-aacef28c-38a9-4f1a-beb2-4e05ff32f557 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155188 Apr 07 17:40:43.326500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 732/1593] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:43 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:43.435715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:43.436267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:43.442578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:43.443037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:43.443801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:43.444238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:43.503669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:43.511969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-72991d5a-0b23-4525-aa3c-05681d3e8ffc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080659 Apr 07 17:40:43.512561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 862/1594] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:44.343536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:44.344143 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:44.350487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:44.350935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:44.351693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:44.352127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:44.484138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:44.492529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-21561d2e-bf37-4e11-a337-29d6602044bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152893 Apr 07 17:40:44.493093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 733/1595] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:44 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:44.528770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:44.529392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:44.535687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:44.536142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:44.536905 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:44.537376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:44.595786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:44.604077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fdd1b0b1-2396-4219-8f08-b3e7039694f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079118 Apr 07 17:40:44.604730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 863/1596] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:45.508816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:45.509998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:45.516269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:45.516717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:45.517506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:45.517947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:45.620609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:45.621242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:45.627562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:45.627940 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:45.628810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:45.629279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:45.650274 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:45.658258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1eb1e759-b36d-435d-9d14-773f3cc0947b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153283 Apr 07 17:40:45.658834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 734/1597] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:45 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:45.694201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:45.703270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c290b3fa-c3ea-4795-8041-3dbddbfdfb7a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.087161 Apr 07 17:40:45.703838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 864/1598] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:46.675450 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:46.676070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:46.683047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:46.683493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:46.684261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:46.684704 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:46.719689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:46.720324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:46.726749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:46.727200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:46.728500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:46.728994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:46.794289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:46.802112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-309994b4-1f68-43dd-b036-424e425d3efa tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086256 Apr 07 17:40:46.802682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 865/1599] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:46 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:46.852659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:46.860983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2fff33fa-474c-4e09-af33-85db16425ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.189402 Apr 07 17:40:46.861585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 735/1600] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:46 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:47.819607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:47.820219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:47.827171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:47.827620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:47.828383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:47.828818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:47.878817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:47.879465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:47.886346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:47.886793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:47.887555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:47.887982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:47.892176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:47.900167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ec2d38a6-182f-4e8f-8f6d-e8fff1c4a8e8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084404 Apr 07 17:40:47.900721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 866/1601] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:48.021318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:48.028955 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-390c0cb7-b5a6-4bbd-8954-5afaa3029465 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153939 Apr 07 17:40:48.029557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 736/1602] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:47 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:48.917778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:48.918389 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:48.924573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:48.925017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:48.925814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:48.926245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:48.986311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:48.994193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3fa45cb3-885e-4f32-b71f-911a9716af7f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080843 Apr 07 17:40:48.994760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 867/1603] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:49.046076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:49.046674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:49.052838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:49.053322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:49.054077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:49.054504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:49.190183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:49.198485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4e2bc5ff-1ee7-46ce-b47c-b04ec8dc2f52 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156175 Apr 07 17:40:49.199055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 737/1604] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:49 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:50.011497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:50.012134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:50.018669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:50.019111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:50.019863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:50.020294 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:50.079055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:50.086703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-356cf942-8461-4c80-9e9d-2006d9734829 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079683 Apr 07 17:40:50.087266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 868/1605] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:50.214923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:50.215649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:50.222046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:50.222495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:50.223253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:50.223685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:50.352340 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:50.360231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-196affbb-9c8d-4811-a59e-57ec2457a355 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149348 Apr 07 17:40:50.360797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 738/1606] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:50 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:51.103582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:51.104249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:51.112344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:51.113132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:51.114527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:51.115271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:51.174142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:51.182560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5068a3c0-16d1-43fa-8a30-cc8ec22ac39f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082999 Apr 07 17:40:51.183119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 869/1607] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:51.378562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:51.378562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:51.384899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:51.385377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:51.386144 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:51.386577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:51.519768 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:51.528094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-10cac590-38cd-4454-b655-e3f8de134fa2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154084 Apr 07 17:40:51.528660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 739/1608] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:51 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:52.200026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:52.200674 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:52.207015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:52.207460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:52.208212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:52.208644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:52.266689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:52.274534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c37858ab-620e-4ab4-9fd2-b72521c4e3f6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078727 Apr 07 17:40:52.275119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 870/1609] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:52.545897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:52.546426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:52.552622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:52.553073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:52.553860 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:52.554292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:52.688190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:52.695874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d5f30d0e-d8fa-4834-90fc-97d37c2a91e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153898 Apr 07 17:40:52.696942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 740/1610] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:52 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:53.291322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:53.291948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:53.298435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:53.298879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:53.299643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:53.300076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:53.359620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:53.367252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3fe63d78-1d93-49c9-b4f4-a3e82e87b248 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079815 Apr 07 17:40:53.367812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 871/1611] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:53.715545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:53.716143 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:53.721999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:53.728190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:53.728190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:53.728190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:53.856477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:53.864198 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6aa2562d-de68-46a0-94bb-c57d2bd78efd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153985 Apr 07 17:40:53.864753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 741/1612] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:53 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:54.385600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:54.386256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:54.392543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:54.392988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:54.394028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:54.394455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:54.452929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:54.460551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7a2e6614-c54b-48bc-bea5-43c40587d9a2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079610 Apr 07 17:40:54.461107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 872/1613] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:54.881567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:54.882155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:54.889328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:54.889788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:54.890591 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:54.891051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:55.025745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:55.033523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2b5ce87b-2ff0-495f-abc4-251b02d291ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155702 Apr 07 17:40:55.034093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 742/1614] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:54 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:55.478753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:55.479373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:55.485616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:55.486059 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:55.486819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:55.487249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:55.548413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:55.556727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fedfaf45-45e5-4014-b581-7cb3e6c70ffb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082410 Apr 07 17:40:55.557320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 873/1615] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:56.051570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:56.052184 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:56.059192 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:56.059645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:56.060410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:56.060856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:56.190097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:56.198426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-59e02e89-243f-47a5-b7f3-fb5d956b9f1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150716 Apr 07 17:40:56.198993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 743/1616] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:56 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:56.574733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:56.575340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:56.582115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:56.582566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:56.583329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:56.583763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:56.645654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:56.653526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a600e06b-7f0b-427d-b1f3-edc6581e3379 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084015 Apr 07 17:40:56.654095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 874/1617] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:57.216183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:57.216795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:57.223041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:57.223520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:57.224281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:57.224716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:57.353619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:57.361377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c24e0ddc-32d5-40f6-ada6-b2153d6c4c88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149607 Apr 07 17:40:57.361939 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 744/1618] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:57 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:57.734903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:57.735514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:57.741506 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:57.741961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:57.742728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:57.743207 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:57.802839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:57.811181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4e4aeb1f-d76b-4541-8232-dc7045c8ff5e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.143931 Apr 07 17:40:57.811783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 875/1619] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:57 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:58.378525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:58.379156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:58.386619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:58.387060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:58.387815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:58.388244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:58.522107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:58.529856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8b73b4d3-b417-44ea-ac24-f8f96a8aed41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155205 Apr 07 17:40:58.530424 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 745/1620] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:58 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:58.828264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:58.828875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:58.835179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:58.835631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:58.836395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:58.836833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:58.895325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:58.903230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-940510ec-e039-485e-a2f8-d5a42aff846f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078782 Apr 07 17:40:58.903734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 876/1621] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:40:59.546853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:59.547474 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:59.553765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:59.554216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:59.554980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:59.555440 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:59.688157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:59.695896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-42279002-1ef6-4b79-bb63-ffbfe228e11a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152893 Apr 07 17:40:59.696973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 746/1622] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:59 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:40:59.920028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:40:59.920639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:40:59.926937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:59.927380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:59.928142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:40:59.928580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:40:59.989435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:40:59.997839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-45ebe584-820c-4b94-9920-f693069b0ff0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081679 Apr 07 17:40:59.998398 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 877/1623] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:40:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:00.713977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:00.714620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:00.720962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:00.721434 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:00.722191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:00.722632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:00.855267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:00.863880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7e3d07ae-eaca-4a73-9d83-bbe53cd70547 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153529 Apr 07 17:41:00.864837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 747/1624] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:00 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:01.015411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:01.016021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:01.022766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:01.023211 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:01.024038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:01.025046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:01.083371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:01.092079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b869c9d1-48bf-48e3-9061-e5df6a8fb7b8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080614 Apr 07 17:41:01.092634 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 878/1625] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:01.881288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:01.881895 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:01.888685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:01.889127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:01.890017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:01.890454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:02.023051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:02.031992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-44503e62-a225-4fa4-9702-ccd79118b594 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154556 Apr 07 17:41:02.032559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 748/1626] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:01 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:02.109251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:02.109862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:02.115870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:02.116317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:02.117078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:02.117541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:02.176069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:02.184122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-de05bc29-e45e-4132-bbf1-e3285c8b75d0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078714 Apr 07 17:41:02.184689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 879/1627] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:03.049734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:03.050346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:03.057214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:03.057668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:03.058436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:03.058875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:03.192109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:03.200563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:03.201070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-13f5a8d8-b4c4-4e4b-938f-ea6f9f770fb5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154960 Apr 07 17:41:03.205742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:03.205875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 749/1628] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:03 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:03.208645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:03.209100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:03.210025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:03.210466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:03.274781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:03.282601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-033658e5-64a3-4739-ab81-a0d567d6dd80 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086537 Apr 07 17:41:03.283165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 880/1629] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:04.218160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:04.218774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:04.224985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:04.225463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:04.226226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:04.226661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:04.299265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:04.300153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:04.307179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:04.307625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:04.308390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:04.308827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:04.375160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:04.382806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cb34258b-dca7-49e6-8842-b75ee94886a1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.087394 Apr 07 17:41:04.383425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 881/1630] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:04.389308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:04.397315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cc368469-dab0-4eef-8ddb-432e5a4a3252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.183087 Apr 07 17:41:04.397867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 750/1631] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:04 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:05.399764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:05.400374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:05.406697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:05.407179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:05.407941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:05.408379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:05.415464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:05.416078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:05.422373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:05.422827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:05.423596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:05.424034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:05.469987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:05.478377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-386a9129-2aaa-4ed1-b6a1-cb5e2cb73c6d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082422 Apr 07 17:41:05.478949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 882/1632] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:05.570036 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:05.577929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-be2d1943-2a0d-47ed-be7d-3e95a5a697bd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.166529 Apr 07 17:41:05.578494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 751/1633] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:05 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:06.494922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:06.495512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:06.501848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:06.502300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:06.503065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:06.503500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:06.564246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:06.572234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4a7b7236-0e61-49be-bb57-7b7f10b9d940 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081258 Apr 07 17:41:06.572793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 883/1634] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:06.594902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:06.595512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:06.601843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:06.603193 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:06.603661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:06.604094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:06.735332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:06.743191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3c7c74dc-cab3-42f6-a747-d8a1abf0d326 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152164 Apr 07 17:41:06.743754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 752/1635] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:06 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:07.589545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:07.590149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:07.596354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:07.596796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:07.597581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:07.598014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:07.659381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:07.667805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-027e5a01-ed29-4404-920d-73a33d74537b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082771 Apr 07 17:41:07.668362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 884/1636] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:07.760980 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:07.761644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:07.768487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:07.768937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:07.769728 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:07.770164 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:07.902170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:07.909999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-72cbade5-d089-4885-a290-8a216f0fba94 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153474 Apr 07 17:41:07.910506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 753/1637] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:07 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:08.684431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:08.685035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:08.691335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:08.691780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:08.692535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:08.692965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:08.751347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:08.759228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fbd36dc6-b5dc-4773-95ee-bc734c29cccb tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079290 Apr 07 17:41:08.759785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 885/1638] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:08.926958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:08.927604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:08.934174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:08.934628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:08.935397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:08.935835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:09.069286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:09.077334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8d731b69-0c5f-445e-934b-f15bfda485f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154235 Apr 07 17:41:09.077912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 754/1639] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:08 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:09.319809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:41:09.320041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:41:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:41:09.775843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:09.776482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:09.782740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:09.783185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:09.783941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:09.784376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:09.842632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:09.850311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0aefa610-e223-436d-ba89-c8eb1efe2169 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078441 Apr 07 17:41:09.850871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 886/1640] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:09 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:10.095175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:10.095822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:10.103130 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:10.103575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:10.104338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:10.104771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:10.233407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:10.241035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6ae61168-47a8-4e3a-a207-651840ba759d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149716 Apr 07 17:41:10.241612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 755/1641] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:10 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:10.867713 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:10.868371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:10.875975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:10.876437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:10.877345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:10.877787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:10.971485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:10.980950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2da1ac2c-c9cf-451c-ace2-e08a5dfcf1f2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.117055 Apr 07 17:41:10.982601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 887/1642] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:11.259798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:11.260348 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:11.267132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:11.267585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:11.269122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:11.269745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:11.412071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:11.421371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-530b775f-ea7d-40e5-b6c6-bc95d345dc22 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.166721 Apr 07 17:41:11.421949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 756/1643] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:11 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:11.999493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:12.000101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:12.006366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:12.006811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:12.007571 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:12.008601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:12.070222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:12.078651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d0cb6d41-b398-4424-a3b0-d901c0251c92 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083034 Apr 07 17:41:12.079209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 888/1644] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:12.439455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:12.440070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:12.446459 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:12.446906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:12.447671 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:12.448116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:12.576391 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:12.584149 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-06e73318-c6e7-4a88-bb57-541b6d37def9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.148558 Apr 07 17:41:12.584716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 757/1645] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:12 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:13.095353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:13.095993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:13.102848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:13.103288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:13.104044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:13.104475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:13.162171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:13.170536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-553d1f97-5228-4d1d-b91d-dd39870430d3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079019 Apr 07 17:41:13.171095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 889/1646] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:13.602681 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:13.603318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:13.609646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:13.610087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:13.610843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:13.611279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:13.744695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:13.752406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-053490a5-7a02-4c13-b48a-f25c6af67cd1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154198 Apr 07 17:41:13.752983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 758/1647] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:13 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:13.849924 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:41:13.850096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:41:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:41:14.187457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:14.188213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:14.194429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:14.194886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:14.196280 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:14.196728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:14.254467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:14.263085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e97a6dee-cc0c-446b-834d-8747ab338437 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079557 Apr 07 17:41:14.263649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 890/1648] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:14.770735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:14.771360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:14.777552 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:14.777995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:14.778745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:14.779175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:14.908283 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:14.917229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-59d0d32e-f6ed-4588-91b8-7cfe07c905f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150567 Apr 07 17:41:14.917784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 759/1649] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:14 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:15.280780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:15.281399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:15.287643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:15.288094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:15.288855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:15.289329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:15.347475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:15.355403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c0fa6dfe-5217-4967-9772-3ced5584fc46 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078568 Apr 07 17:41:15.355962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 891/1650] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:15.934995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:15.935606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:15.941915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:15.942360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:15.943117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:15.943550 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:16.077839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:16.085554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d593dd80-d683-413f-adde-7e40cf028b04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154390 Apr 07 17:41:16.086198 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 760/1651] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:15 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:16.372537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:16.373077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:16.379329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:16.379774 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:16.380533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:16.380962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:16.440021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:16.448225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ddfbd60e-92fa-4921-b65b-27c3782066b3 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079652 Apr 07 17:41:16.448787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 892/1652] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:17.103007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:17.103604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:17.109884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:17.110337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:17.111094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:17.111528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:17.247786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:17.255401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b325ea02-defd-4b3e-81f0-c5d0483bad88 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156272 Apr 07 17:41:17.255959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 761/1653] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:17 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:17.465102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:17.465728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:17.471947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:17.472388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:17.473310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:17.473739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:17.533962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:17.542446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-96e70d21-af14-4cbd-b567-3f7342e236ef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081384 Apr 07 17:41:17.543003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 893/1654] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:18.275509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:18.276115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:18.282390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:18.282831 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:18.283586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:18.284016 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:18.413898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:18.421644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-92f16694-7c03-4971-892b-9580b5041d65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151294 Apr 07 17:41:18.422217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 762/1655] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:18 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:18.559683 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:18.560246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:18.566500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:18.566948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:18.567705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:18.568142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:18.627188 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:18.635485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-28c3e9f7-c7a6-4982-a60e-d2b6bb7e8cf8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079747 Apr 07 17:41:18.636041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 894/1656] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:19.438977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:19.439594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:19.446695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:19.447119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:19.447877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:19.448308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:19.583496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:19.591897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d984d100-cabb-4025-94ce-94794017cbfd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156832 Apr 07 17:41:19.592458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 763/1657] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:19 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:19.653107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:19.653668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:19.659868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:19.660313 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:19.661065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:19.661526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:19.720598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:19.728558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d2c6ab6f-6a66-4016-8441-157337630372 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080001 Apr 07 17:41:19.729343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 895/1658] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:20.609158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:20.609776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:20.616097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:20.616544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:20.618091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:20.618492 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:20.746287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:20.747321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:20.748911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:20.753182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:20.753629 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:20.754394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:20.754826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:20.756660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eb50ebd7-496a-4c15-8273-64e19c6f53ec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151333 Apr 07 17:41:20.757245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 764/1659] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:20 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:20.817753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:20.825684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cc3d1bf2-a595-4d59-be44-c02be8f17820 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084504 Apr 07 17:41:20.826255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 896/1660] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:20 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:21.774562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:21.775168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:21.781631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:21.782079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:21.782838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:21.783275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:21.842639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:21.843840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:21.850042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:21.850485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:21.851281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:21.852345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:21.920227 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:21.927939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5bb68715-b42e-40cb-bcdd-1d667bd747c6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.089128 Apr 07 17:41:21.928516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 897/1661] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:21.939375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:21.947873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5d1fddef-3d52-4541-b38c-5336e620f0e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.177253 Apr 07 17:41:21.948433 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 765/1662] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:21 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:22.945971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:22.946569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:22.952880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:22.953365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:22.954126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:22.954561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:22.965372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:22.965978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:22.972287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:22.972810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:22.973633 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:22.974068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:23.019079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:23.028084 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2c6a8778-417b-4704-94ff-efdc0bcd726b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086481 Apr 07 17:41:23.028663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 898/1663] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:23.117647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:23.125454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3443bb26-0959-4496-8fc8-affa3982d35f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.164376 Apr 07 17:41:23.126015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 766/1664] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:22 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:24.044949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:24.045588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:24.051962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:24.052412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:24.053199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:24.053637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:24.112478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:24.120739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-62c3462d-93f7-4731-87e3-7fe8119e898c tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079680 Apr 07 17:41:24.121325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 899/1665] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:24.143454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:24.144089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:24.150588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:24.151037 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:24.151796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:24.152235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:24.284470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:24.293393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ec7e7ba5-7817-480c-b495-83e5a9bd2a4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154015 Apr 07 17:41:24.293944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 767/1666] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:24 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:25.138029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:25.138635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:25.145382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:25.145836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:25.146605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:25.147038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:25.207587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:25.215502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fcf318ec-3d70-41ba-87b9-2b0ee41c5987 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081392 Apr 07 17:41:25.216531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 900/1667] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:25.311527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:25.312128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:25.318529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:25.318973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:25.319735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:25.320273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:25.449114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:25.456928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-17141ac1-4c74-4c5e-ab9f-c3fa81e247e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149291 Apr 07 17:41:25.457515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 768/1668] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:25 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:26.232838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:26.233465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:26.239794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:26.240233 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:26.240997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:26.241456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:26.300068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:26.308346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c09005bd-18b6-460d-bbdb-a4326f2f028a tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079720 Apr 07 17:41:26.308899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 901/1669] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:26.474593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:26.475195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:26.482401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:26.482904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:26.483590 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:26.484017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:26.616481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:26.624778 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2ea3973b-d8ac-4c84-a3b6-0cec0b2c6a69 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154048 Apr 07 17:41:26.625375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 769/1670] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:26 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:27.325404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:27.325995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:27.332439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:27.332882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:27.333680 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:27.334120 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:27.392485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:27.400472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c4597ff5-32d7-4317-9df4-cb5b924292c8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079024 Apr 07 17:41:27.401030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 902/1671] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:27.642491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:27.643258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:27.650559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:27.651006 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:27.651762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:27.652218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:27.783666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:27.791978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cda300da-2c49-42eb-a2b4-ca1309b079d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153407 Apr 07 17:41:27.792544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 770/1672] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:27 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:28.416943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:28.417560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:28.423878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:28.424323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:28.425082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:28.425539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:28.484038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:28.492567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-73a3ba97-a294-4c59-bcec-757c50ecc2a0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078696 Apr 07 17:41:28.493169 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 903/1673] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:28.808940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:28.809501 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:28.815737 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:28.816182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:28.816935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:28.817392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:28.945448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:28.953053 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-298ceb71-eecf-4d69-abb7-474edf6aa6f8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.148709 Apr 07 17:41:28.953634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 771/1674] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:28 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:29.510447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:29.511073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:29.517413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:29.518124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:29.518880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:29.519312 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:29.582351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:29.592775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dd4c0d88-3740-413a-8bff-a1dd76a67053 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086794 Apr 07 17:41:29.593381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 904/1675] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:29.970281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:29.970885 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:29.977287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:29.977731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:29.978480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:29.978908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:30.112228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:30.120545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a25d2050-ef35-40e3-ac06-42ba8799d5c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154083 Apr 07 17:41:30.121115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 772/1676] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:29 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:30.610278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:30.610906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:30.617555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:30.618000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:30.618761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:30.619194 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:30.680527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:30.688359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-00fe5890-f94b-4081-a693-2c75084c3fce tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081919 Apr 07 17:41:30.688917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 905/1677] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:31.189832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:31.190447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:31.196927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:31.197406 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:31.198173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:31.198606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:31.331863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:31.339958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-00644261-0810-41b5-ab11-9c1c2b76de8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153994 Apr 07 17:41:31.340531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 773/1678] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:31 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:31.712319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:31.712922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:31.718913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:31.719360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:31.720143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:31.720761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:31.784340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:31.792055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-45c6118b-cff0-4b74-bf1e-1b69bf1630e0 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084182 Apr 07 17:41:31.792610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 906/1679] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:31 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:32.356919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:32.357585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:32.363899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:32.364346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:32.365094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:32.365549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:32.497111 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:32.504774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-726c5f73-07f7-49fd-9bd2-45b0ecfd1bf7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151747 Apr 07 17:41:32.505370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 774/1680] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:32 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:32.808868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:32.809512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:32.815523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:32.815973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:32.816735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:32.817195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:32.874989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:32.882850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d2b23537-b1cb-4eb9-8eb0-2c1aac6173b2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079034 Apr 07 17:41:32.883412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 907/1681] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:33.521965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:33.522514 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:33.528737 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:33.529210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:33.529972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:33.530408 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:33.887489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:33.895532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cfdbc955-8dfd-47d0-8a38-72bf46974b3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.377898 Apr 07 17:41:33.896095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 775/1682] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:33 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:33.899491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:33.900098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:33.906386 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:33.906836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:33.907598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:33.908038 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:33.968217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:33.976590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bd136638-bfb9-4068-bb2a-5bbd7407cbc8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080341 Apr 07 17:41:33.977186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 908/1683] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:34.914033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:34.914644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:34.920720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:34.921263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:34.922039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:34.922469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:34.994302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:34.995003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:35.001529 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:35.001887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:35.002727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:35.003169 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:35.070979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:35.078815 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-771415f3-7ced-4d18-855e-63ed25834c15 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.089308 Apr 07 17:41:35.079395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 909/1684] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:35.079772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:35.088188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5b9dba55-fd24-4be9-8a03-59596350cd82 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.178769 Apr 07 17:41:35.088918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 776/1685] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:34 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:36.096499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:36.097186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:36.104102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:36.104549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:36.105269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:36.105723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:36.105859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:36.105985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:36.112072 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:36.112520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:36.113317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:36.113752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:36.173245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:36.182097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-55050b3b-d4c7-48a8-9a86-191beaebeb21 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.089432 Apr 07 17:41:36.182675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 910/1686] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:36 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:36.259357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:36.267047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b040bb45-fe84-4bc0-a120-7c09350be297 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.165637 Apr 07 17:41:36.267610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 777/1687] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:36 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:37.199426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:37.200035 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:37.206351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:37.206795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:37.207580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:37.208011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:37.266981 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:37.275346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4893a63e-6c75-48c2-acc1-ee7391e4f508 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080000 Apr 07 17:41:37.275907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 911/1688] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:37 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:37.288598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:37.289251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:37.295500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:37.295952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:37.296719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:37.297208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:37.429388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:37.437060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-454073ee-353f-41e9-bde1-4c13790adabe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152935 Apr 07 17:41:37.437645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 778/1689] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:37 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:38.296808 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:38.297443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:38.304573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:38.305129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:38.305912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:38.306348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:38.364096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:38.372351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b5770cfd-c095-46db-9a62-9cddc8802e13 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079385 Apr 07 17:41:38.372912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 912/1690] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:38 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:38.454370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:38.454982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:38.461276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:38.461730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:38.462493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:38.462932 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:38.593339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:38.601806 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-986e8fa4-9a81-4604-9631-f2210caf77a3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151234 Apr 07 17:41:38.602377 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 779/1691] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:38 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:38.603540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:41:38.603704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:41:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:41:39.389866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:39.390509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:39.398132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:39.398584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:39.399361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:39.399801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:39.460804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:39.468537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-83a8214a-04e1-41b2-b3ab-aaaf7e07b0ab tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082611 Apr 07 17:41:39.469096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 913/1692] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:39 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:39.619473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:39.620003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:39.626320 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:39.626772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:39.627527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:39.627964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:39.760556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:39.768541 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-610d604e-8e45-4fb3-b13d-fb2c0f7dc4d3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153536 Apr 07 17:41:39.769099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 780/1693] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:39 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:40.485250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:40.485865 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:40.492327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:40.492775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:40.493567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:40.494005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:40.552439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:40.560541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ebad9d7f-87ee-4ff2-acfb-d9b29ca913f8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079211 Apr 07 17:41:40.561108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 914/1694] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:40 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:40.786349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:40.786863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:40.793405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:40.794097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:40.794864 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:40.795299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:40.930349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:40.938166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ee3ce3ed-e5ce-4c45-9199-67c058208221 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155773 Apr 07 17:41:40.938725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 781/1695] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:40 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:41.579729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:41.580340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:41.586816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:41.587271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:41.588041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:41.588485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:41.647043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:41.655343 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fe624621-bd2e-4b84-8ae2-7004d4eede07 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079431 Apr 07 17:41:41.655915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 915/1696] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:41 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:41.954707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:41.955321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:41.962624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:41.963068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:41.963821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:41.964255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:42.093946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:42.102150 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4e637add-1e01-4c1a-bce8-1da768065611 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151284 Apr 07 17:41:42.102712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 782/1697] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:41 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:42.671783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:42.672394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:42.679119 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:42.679392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:42.680158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:42.680593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:42.746151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:42.753855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9a16f6ce-f3b7-462d-a366-5332bdc20654 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086013 Apr 07 17:41:42.754412 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 916/1698] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:42 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:43.119333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:43.119975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:43.126222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:43.126669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:43.127428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:43.127866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:43.257385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:43.265110 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-73a8dcab-769d-4cad-8205-7e050e5d7e1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149702 Apr 07 17:41:43.265693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 783/1699] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:43 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:43.770964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:43.771562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:43.778086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:43.779630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:43.779630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:43.779847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:43.838493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:43.846217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-56ac7d79-884a-4dab-af9d-100d5b557597 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079435 Apr 07 17:41:43.846778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 917/1700] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:43 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:44.283014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:44.283631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:44.290812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:44.291263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:44.292027 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:44.292467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:44.424368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:44.432179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-04723795-2a1f-4d7d-a267-9bdbb18cd2fb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153032 Apr 07 17:41:44.432746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 784/1701] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:44 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:44.863221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:44.863836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:44.870273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:44.870943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:44.872011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:44.872642 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:44.933571 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:44.941566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-10729382-4f47-48b3-9974-1e5872ab2d8b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082239 Apr 07 17:41:44.942136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 918/1702] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:44 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:45.450089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:45.450702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:45.456962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:45.457441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:45.458200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:45.458630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:45.587882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:45.595577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-aed88016-3079-470a-a857-dac21247741e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149356 Apr 07 17:41:45.596152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 785/1703] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:45 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:45.958335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:45.958950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:45.965958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:45.966411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:45.967185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:45.967621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:46.030597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:46.039566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-96cc53e3-672c-48ce-8d76-32cc8f9dd03f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.085159 Apr 07 17:41:46.040130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 919/1704] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:45 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:46.613010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:46.613696 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:46.620356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:46.620796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:46.621607 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:46.622038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:46.752351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:46.760086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c6e8835a-70dd-41ed-9320-c2babcead954 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150941 Apr 07 17:41:46.760646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 786/1705] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:46 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:47.056113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:47.056721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:47.063002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:47.063458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:47.064218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:47.064653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:47.123928 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:47.131581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8e7139ca-ecf9-4ff2-9d40-c2dbb5b0c168 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080037 Apr 07 17:41:47.132136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 920/1706] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:47 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:47.778120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:47.778731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:47.785077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:47.785567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:47.786332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:47.786776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:47.921635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:47.929903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2f5beb55-7a7f-44e2-8c05-3d5521936252 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155730 Apr 07 17:41:47.930474 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 787/1707] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:47 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:48.149384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:48.149920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:48.156175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:48.156628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:48.157411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:48.157851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:48.219837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:48.228294 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-80ed0f62-9281-4276-910c-ffaafb39215e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083122 Apr 07 17:41:48.228862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 921/1708] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:48 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:48.948277 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:48.948867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:48.955082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:48.955529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:48.956281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:48.956708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:49.087190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:49.095126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-29404a48-2b30-40a8-b59f-049c74135dbb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151710 Apr 07 17:41:49.095699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 788/1709] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:48 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:49.244352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:49.244912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:49.251257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:49.251707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:49.252469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:49.252907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:49.313130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:49.321820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6fd9927e-9528-488d-b4ea-b096df55567f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081627 Apr 07 17:41:49.322379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 922/1710] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:49 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:50.113640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:50.114245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:50.120997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:50.121471 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:50.122232 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:50.122663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:50.258699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:50.266602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-66356941-e71e-4e5c-9bce-eda5ac44ac14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156774 Apr 07 17:41:50.267173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 789/1711] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:50 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:50.338695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:50.339302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:50.345613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:50.346060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:50.346818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:50.347253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:50.406574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:50.414932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b4c9fdc9-81a8-4d57-bae8-3f2717c6208f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080458 Apr 07 17:41:50.415485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 923/1712] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:50 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:51.284030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:51.284641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:51.291082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:51.291533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:51.292325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:51.292759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:51.425784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:51.431916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:51.432522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:51.433730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d218b333-d4c6-45b1-905f-202b7a4d4d8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153538 Apr 07 17:41:51.434306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 790/1713] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:51 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:51.438966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:51.439417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:51.440166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:51.440627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:51.499619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:51.508507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f31d2568-68c9-446b-be6e-f720d4b1939b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080500 Apr 07 17:41:51.509073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 924/1714] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:51 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:52.451188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:52.451798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:52.458156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:52.458604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:52.459364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:52.460346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:52.526425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:52.527032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:52.533527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:52.533975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:52.534740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:52.535173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:52.605752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:52.613341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cf83e533-f2c2-4796-9b28-428157e55a53 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.091641 Apr 07 17:41:52.616484 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:52.617441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 925/1715] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:52 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:52.624276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bf6145e4-014b-45bf-a870-732ef735331b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.176988 Apr 07 17:41:52.624837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 791/1716] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:52 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:52.704672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:41:52.704827 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:41:53.631143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:53.632323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:53.638686 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:53.639138 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:53.639910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:53.640354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:53.641322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:53.641962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:53.649327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:53.651849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:53.651849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:53.651849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:53.712604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:53.720436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c9dd28ca-26ba-467c-84f1-96e65e08dc62 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.093375 Apr 07 17:41:53.720997 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 926/1717] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:53 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:53.800464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:53.809114 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6afa9ccb-78e0-4c94-a59b-98e8f8b06085 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.171800 Apr 07 17:41:53.809707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 792/1718] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:53 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:54.737935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:54.738539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:54.745271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:54.745717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:54.746538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:54.751406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:54.812449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:54.820837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-89892a87-6c3c-43be-a8ce-15d77039c721 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.086798 Apr 07 17:41:54.821515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 927/1719] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:54 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:54.826225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:54.826835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:54.833176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:54.833626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:54.834380 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:54.835402 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:54.969956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:54.977904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-88b60027-f761-4209-bdd9-15d4b1f9257a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155438 Apr 07 17:41:54.978467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 793/1720] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:54 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:41:55.839012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:55.839647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:55.846061 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:55.846499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:55.847258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:55.847752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:55.907136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:55.915150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-051e47cc-fdcb-4994-a472-50d88d3d19d2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081311 Apr 07 17:41:55.915932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 928/1721] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:55 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:55.996030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:55.996662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:56.002891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:56.003338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:56.004096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:56.004526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:56.137342 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:56.149276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-53be83ac-c8d9-4a12-bbac-78cfd0b15363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156811 Apr 07 17:41:56.150105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 794/1722] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:55 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:56.932734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:56.933385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:56.939599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:56.940045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:56.940902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:56.941372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:56.999661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:57.007995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b2dada8a-1fdd-4737-8f2e-30526a1bf650 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079804 Apr 07 17:41:57.008549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 929/1723] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:56 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:57.168004 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:57.168619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:57.175112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:57.175567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:57.176355 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:57.176781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:57.316242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:57.324423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3aed8d9e-60f5-45f5-95e2-be938d819655 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.161434 Apr 07 17:41:57.324979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 795/1724] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:57 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:58.025073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:58.025763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:58.032079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:58.032522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:58.033319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:58.033753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:58.092341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:58.100064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3baef2f2-5e94-4721-8019-d15f3936b2e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079931 Apr 07 17:41:58.100826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 930/1725] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:58 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:58.341223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:58.341792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:58.348142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:58.348616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:58.349476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:58.349924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:58.686658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:58.695356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a63aaf4a-a781-46cf-8ec2-f927bd4625bf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.357571 Apr 07 17:41:58.695918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 796/1726] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:58 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:59.117769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:59.118388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:59.124626 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:59.125077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:59.125868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:59.126305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:59.187082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:59.195250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-edbe3e18-9cae-491e-bf6b-4a11b2d984be tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082081 Apr 07 17:41:59.195836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 931/1727] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:59 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:41:59.712409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:41:59.713047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:41:59.719427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:59.719871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:59.720635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:41:59.721062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:41:59.856008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:41:59.863741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-178a364b-e522-4ebb-81b2-45a0239a1581 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155207 Apr 07 17:41:59.864306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 797/1728] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:41:59 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:00.211938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:00.212552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:00.218940 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:00.219397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:00.220168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:00.220611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:00.283401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:00.291170 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b8fbf49a-ac16-493e-b992-ca5510e54cef tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083273 Apr 07 17:42:00.291727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 932/1729] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:00 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:00.882485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:00.883097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:00.889342 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:00.891091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:00.891091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:00.891091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:01.027037 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:01.034959 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c68fc0dc-25cf-43d3-837e-dc8cee3527fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157416 Apr 07 17:42:01.035528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 798/1730] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:00 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:01.308077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:01.308692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:01.315010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:01.315450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:01.316199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:01.316629 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:01.376046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:01.384189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5ceca6de-0cb1-4b4f-9469-6d9f4ecafadd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080960 Apr 07 17:42:01.384747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 933/1731] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:01 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:02.052482 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:02.053623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:02.059859 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:02.060305 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:02.061063 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:02.061524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:02.190496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:02.198946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-92f65db4-1bc4-499e-81e6-d9bf5cb041a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150354 Apr 07 17:42:02.199509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 799/1732] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:02 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:02.400786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:02.401406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:02.407787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:02.408230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:02.408983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:02.409447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:02.472275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:02.480587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f750bab6-2d74-489a-9a23-41769e91249f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083845 Apr 07 17:42:02.481183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 934/1733] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:02 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:03.216711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:03.217353 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:03.223644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:03.224097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:03.224872 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:03.225357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:03.359881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:03.367632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dffa60a1-d05b-4197-9d94-ef6e5d9e1194 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154787 Apr 07 17:42:03.368203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 800/1734] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:03 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:03.497560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:03.498095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:03.504426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:03.504871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:03.505738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:03.506109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:03.565485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:03.574293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0a7774db-9643-4fc9-97e3-2ce0c7882232 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080667 Apr 07 17:42:03.574858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 935/1735] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:03 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:04.384943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:04.385585 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:04.391505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:04.391949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:04.392968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:04.393429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:04.528987 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:04.536758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-359763dd-4269-4c67-92f7-3c11418e39b0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155805 Apr 07 17:42:04.537354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 801/1736] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:04 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:04.597712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:04.598358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:04.605558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:04.606017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:04.606824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:04.607266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:04.666944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:04.674800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-559c45c1-48c5-4d8a-bb79-4cf0141eef4d tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080904 Apr 07 17:42:04.675367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 936/1737] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:04 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:05.555640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:05.556240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:05.562477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:05.562918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:05.563665 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:05.564091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:05.691694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:05.692309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:05.694950 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:05.699502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:05.699953 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:05.700734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:05.701196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:05.703388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bb85d5cc-e5f6-4b47-bc6a-ea88a63fea29 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152473 Apr 07 17:42:05.703957 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 802/1738] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:05 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:05.769476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:05.777794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ab8a21e4-ca64-4454-87b2-d28840069970 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.090037 Apr 07 17:42:05.778361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 937/1739] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:05 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:06.720867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:06.721495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:06.728185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:06.728624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:06.729473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:06.729904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:06.795573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:06.796275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:06.802487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:06.803020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:06.803796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:06.804908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:06.875221 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:06.884226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-89d8038a-ce97-4571-8342-3ebaef84b513 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.092299 Apr 07 17:42:06.884621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 938/1740] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:06 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:06.886744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:06.894836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-27b2e29d-63e1-406d-a574-584486e19f4c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.177852 Apr 07 17:42:06.895381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 803/1741] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:06 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:07.901758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:07.902312 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:07.908599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:07.909047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:07.909846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:07.910281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:07.911493 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:07.912131 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:07.918601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:07.919046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:07.919845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:07.920271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:07.976968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:07.984742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-529ebd22-486f-4c8c-ac9d-2780af2e945b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.087516 Apr 07 17:42:07.985329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 939/1742] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:07 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:08.067358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:08.075854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a87fd632-4189-4ced-bb4b-abc0ce8884ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.168149 Apr 07 17:42:08.076429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 804/1743] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:07 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:09.001373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:09.001987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:09.008598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:09.009048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:09.009853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:09.010290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:09.069844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:09.077605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1e25074b-2f35-4290-8b31-3db22f13cba6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080046 Apr 07 17:42:09.078171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 940/1744] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:08 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:09.093070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:09.093707 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:09.099919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:09.100369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:09.102162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:09.110588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:09.232073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:09.239734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3551755a-be91-4c72-af99-ce107ab8de90 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150474 Apr 07 17:42:09.240291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 805/1745] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:09 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:10.095065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:10.095704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:10.102242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:10.102696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:10.103474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:10.103917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:10.167528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:10.175411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-422c92bf-674a-44f0-9c65-d14303814486 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.084333 Apr 07 17:42:10.175978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 941/1746] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:10 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:10.256636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:10.257957 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:10.264200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:10.264643 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:10.265435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:10.265871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:10.397830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:10.405691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e81c5bf7-e498-401f-8cf8-350eccdbbca5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152875 Apr 07 17:42:10.406249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 806/1747] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:10 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:11.192177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:11.192792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:11.199167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:11.199620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:11.200389 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:11.200833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:11.259519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:11.267241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-547d1aa8-34f7-480d-a9eb-b54b174e471f tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078979 Apr 07 17:42:11.268072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 942/1748] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:11 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:11.423269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:11.424230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:11.430749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:11.431195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:11.431963 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:11.432396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:11.658735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:11.667120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-17f36464-81b5-4800-b0f6-60803feb1a89 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.247654 Apr 07 17:42:11.667794 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 807/1749] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:11 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:12.285420 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:12.285947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:12.298485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:12.298926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:12.300012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:12.300144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:12.370489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:12.378787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e7a447ea-202e-4c14-ac0d-c2d93cfeb9e1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.097373 Apr 07 17:42:12.379359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 943/1750] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:12 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:12.684311 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:12.684915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:12.691232 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:12.691670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:12.692418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:12.692845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:12.830625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:12.838740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-194e86e6-9971-433f-bf9a-7cf9f1b01c4e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.158296 Apr 07 17:42:12.839309 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 808/1751] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:12 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:13.396111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:13.396723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:13.403535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:13.403992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:13.404766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:13.405236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:13.463895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:13.471679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-db25542e-aaa5-4b79-aa6b-868ff0efa526 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079709 Apr 07 17:42:13.472246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 944/1752] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:13 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:13.856753 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:13.857401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:13.863613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:13.864059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:13.864847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:13.865428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:13.993217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:14.001127 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-175042da-cc56-4c85-8fee-3479c7b1375d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.148497 Apr 07 17:42:14.001714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 809/1753] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:13 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:14.489393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:14.489998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:14.496973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:14.497453 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:14.498215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:14.498647 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:14.561479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:14.569179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-de418026-1934-4f14-812a-580df189d616 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083702 Apr 07 17:42:14.570183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 945/1754] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:14 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:15.019223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:15.019836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:15.026551 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:15.026992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:15.027742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:15.028171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:15.161613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:15.169932 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3a0a32a6-421b-4129-a26c-27986c529456 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154868 Apr 07 17:42:15.170503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 810/1755] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:15 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:15.587252 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:15.587852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:15.594089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:15.594528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:15.595282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:15.595712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:15.655569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:15.664030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f98ae194-8eb8-493a-9b55-1eb0a5af0e98 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080865 Apr 07 17:42:15.664589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 946/1756] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:15 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:16.187776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:16.188385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:16.195201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:16.195654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:16.196418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:16.196884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:16.328995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:16.336760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cc79d72a-fb75-4d46-b35c-253f16019737 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152822 Apr 07 17:42:16.337350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 811/1757] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:16 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:16.679822 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:16.680435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:16.686758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:16.687212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:16.687979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:16.688424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:16.746899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:16.754641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-08467e16-46f6-4440-aa81-08382f5b1042 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078756 Apr 07 17:42:16.755213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 947/1758] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:16 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:17.354301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:17.354903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:17.361107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:17.361578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:17.362333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:17.362761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:17.493923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:17.501576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f8324b55-509b-4590-9519-649cfe7e0504 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151512 Apr 07 17:42:17.502132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 812/1759] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:17 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:17.773109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:17.773738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:17.780042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:17.780492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:17.781298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:17.781735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:17.840338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:17.847989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0e210b18-680f-4cd4-a515-3adf49f6f580 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.079308 Apr 07 17:42:17.848551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 948/1760] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:17 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:18.519470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:18.520073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:18.526998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:18.527444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:18.528238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:18.528678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:18.661909 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:18.669846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-82b72471-7caa-462e-b4bd-1795e9fd4900 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154482 Apr 07 17:42:18.670413 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 813/1761] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:18 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:18.865404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:18.866858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:18.873020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:18.873510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:18.874272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:18.874708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:18.935500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:18.943154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f4fdd5bf-8c5e-4330-a74c-7a67136c0b41 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081619 Apr 07 17:42:18.943713 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 949/1762] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:18 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:19.687205 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:19.687748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:19.694369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:19.695180 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:19.695949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:19.696381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:19.826991 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:19.835546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-458477dc-e9c5-4ed5-9ea4-5aab316626ee tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151839 Apr 07 17:42:19.835893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 814/1763] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:19 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:19.960811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:19.961374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:19.967666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:19.968117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:19.968884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:19.969362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:20.029039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:20.036780 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-75991ef9-cafb-465d-ba49-da1736cbcba2 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080244 Apr 07 17:42:20.037380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 950/1764] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:19 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:20.852976 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:20.853623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:20.860204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:20.860884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:20.861749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:20.862188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:20.991967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:20.999625 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a4596759-3a0c-4cc1-8cce-391c874f341f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151141 Apr 07 17:42:21.000183 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 815/1765] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:20 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:21.054501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:21.055116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:21.061517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:21.061975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:21.062749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:21.063201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:21.125020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:21.133440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6216759a-29d5-4fad-8d73-7ba00d45f4bc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.083254 Apr 07 17:42:21.134015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 951/1766] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:21 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:22.017022 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:22.017930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:22.024806 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:22.025281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:22.026034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:22.026460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:22.150958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:22.151573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:22.157909 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:22.158220 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:22.158358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:22.159123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:22.159588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:22.165924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0fc375a1-f843-4042-80fa-66bc389b02aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152699 Apr 07 17:42:22.166487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 816/1767] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:22 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:22.218755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:22.226599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e1b58d0c-e7a3-4725-a36c-4568501b5e4e tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080137 Apr 07 17:42:22.227165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 952/1768] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:22 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:23.183120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:23.183724 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:23.190049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:23.190494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:23.191252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:23.191680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:23.244116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:23.244822 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:23.251284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:23.251734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:23.252499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:23.252943 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:23.325018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:23.332742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f3d02f19-509b-472e-a2f9-f0c48de161e7 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.093186 Apr 07 17:42:23.333333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 953/1769] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:23 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:23.351161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:23.358946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6cdf8f23-7aa9-41c3-9d4f-9103ed8d0428 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.179685 Apr 07 17:42:23.359515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 817/1770] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:23 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:24.349925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:24.351115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:24.357426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:24.357879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:24.358678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:24.359117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:24.376313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:24.376915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:24.383265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:24.383709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:24.384464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:24.384892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:24.420266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:24.429253 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f1fcf47e-1210-41c0-abac-b4a786e6bb33 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082313 Apr 07 17:42:24.429858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 954/1771] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:24 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:24.515957 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:24.524895 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5e584bc4-bbaa-48e9-8d8b-d009524fb398 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152424 Apr 07 17:42:24.525488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 818/1772] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:24 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:42:25.446369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:25.446983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:25.453278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:25.453733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:25.454495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:25.454933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:25.516137 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:25.524682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-eb672a14-5788-4984-833d-d6cc700b9a84 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.082298 Apr 07 17:42:25.525260 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 955/1773] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:25 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:25.542950 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:25.543556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:25.549763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:25.550199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:25.550945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:25.551373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:25.680381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:25.688185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8ff34feb-2683-4c4c-8d15-24c6d9bebd65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150176 Apr 07 17:42:25.688744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 819/1774] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:25 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:26.541007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:26.541621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:26.547887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:26.548327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:26.549270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:26.549704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:26.609295 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:26.617823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0f19ca03-99f2-45a9-8da1-8d2c374e2be8 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081198 Apr 07 17:42:26.618392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 956/1775] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:26 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:26.705745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:26.706498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:26.712794 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:26.713270 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:26.714033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:26.714466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:26.849243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:26.857903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-748322e2-edae-4882-8ea4-c9a3a563ebe8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155952 Apr 07 17:42:26.858463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 820/1776] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:26 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:27.634531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:27.635144 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:27.641470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:27.641917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:27.642944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:27.643381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:27.703474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:27.711784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-02f63bf1-d238-42d8-9e14-dc25339355bd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.081246 Apr 07 17:42:27.712347 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 957/1777] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:27 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:27.874547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:27.875187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:27.881929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:27.882442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:27.883200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:27.883634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:28.011640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:28.019510 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eb30fb74-a93b-4abb-8102-0bfeeb029783 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.148811 Apr 07 17:42:28.020066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 821/1778] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:27 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:28.729053 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:28.729700 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:28.736013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:28.736467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:28.737268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:28.737716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:28.801439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:28.809947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1d6beb89-6372-47a0-bb68-acdd1dfff6b1 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.085521 Apr 07 17:42:28.810516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 958/1779] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:28 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:29.037172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:29.038339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:29.044588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:29.045035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:29.045829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:29.046261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:29.176947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:29.184738 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e99a3d0d-11c4-42fc-90a1-5270e3ddeec8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151484 Apr 07 17:42:29.185334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 822/1780] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:29 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:29.826719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:29.827249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:29.833494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:29.833942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:29.835358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:29.835801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:29.894648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:29.902816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cbd57224-e149-4583-a358-44f1fcc619e4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080010 Apr 07 17:42:29.903418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 959/1781] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:29 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:30.202280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:30.202974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:30.209235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:30.210468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:30.211024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:30.211454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:30.341888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:30.349495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f1945b18-039b-4e94-af91-c9556f12e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151000 Apr 07 17:42:30.350116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 823/1782] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:30 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:30.919417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:30.920082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:30.926338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:30.926787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:30.927540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:30.927973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:30.986765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:30.995718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-559bca6f-71bc-4037-a2e2-e5962f434116 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080239 Apr 07 17:42:30.996270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 960/1783] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:30 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:31.367504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:31.368055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:31.374420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:31.374867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:31.375629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:31.376062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:31.507085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:31.514978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ee3a149-1604-445e-890c-982d6e2b3f68 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151567 Apr 07 17:42:31.515548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 824/1784] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:31 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:32.012464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:32.013075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:32.019381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:32.019834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:32.020603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:32.021042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:32.078795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:32.086525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-12c71f68-5ad4-41ed-9d04-5cf4cf755298 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.078024 Apr 07 17:42:32.087099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 961/1785] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:32 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:32.533129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:32.533758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:32.541317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:32.541761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:32.542511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:32.543154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:32.676026 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:32.684582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-404dad71-98c8-4a6b-ad81-be33b9bdd1a7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155301 Apr 07 17:42:32.685178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 825/1786] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:32 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:33.103748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:33.104359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:33.110712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:33.111160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:33.111961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:33.112397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:33.171823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:33.179697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0d8c6b2a-6ee5-47eb-82da-3539d5fb84c4 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080377 Apr 07 17:42:33.181635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 962/1787] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:33 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:33.701236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:33.701762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:33.708103 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:33.708553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:33.709904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:33.710464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:33.846548 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:33.854879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a30e261f-ee1f-48a1-91a5-9ed48b36d952 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157692 Apr 07 17:42:33.855441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 826/1788] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:33 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:34.196710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:34.197363 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 3966d8bc-6664-4582-a275-e7dcfbcba3cc] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:34.203681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:34.204131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:34.204895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:34.205370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:34.264667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:34.273526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f3e09764-a146-464a-a984-9bcb2e7c6444 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc" status: 200 len: 1376 microversion: 2.1 time: 0.080797 Apr 07 17:42:34.274096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 963/1789] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:34 2022] GET /compute/v2.1/servers/3966d8bc-6664-4582-a275-e7dcfbcba3cc => generated 1376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:34.290074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0179b97d-41be-405b-9cad-45ab4961d636 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '.version_select at 0x7ff9d54abb80>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:34.373063 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0179b97d-41be-405b-9cad-45ab4961d636 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487888967" status: 202 len: 0 microversion: 2.1 time: 0.087644 Apr 07 17:42:34.373666 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 827/1790] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Apr 7 17:42:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1487888967 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:42:34.872075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:34.872681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:34.878609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:34.879063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:34.879837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:34.880279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:35.044533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:35.052457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0c21b1e2-4993-403f-9f20-c88c2c451c79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.184232 Apr 07 17:42:35.053178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 964/1791] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:34 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:36.070780 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:36.071396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:36.077216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:36.077674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:36.078443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:36.078883 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:36.418109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-192a411a-f710-4563-a0a4-5d638233c1ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] Calling method '.version_select at 0x7ff9d0616040>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:36.437443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:36.457805 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bd3d4451-d10a-43ee-9288-b7f1047bd7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.391914 Apr 07 17:42:36.458385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 828/1792] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:36 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:36.504991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-192a411a-f710-4563-a0a4-5d638233c1ca tempest-TestVolumeBootPattern-309520843 tempest-TestVolumeBootPattern-309520843-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-546378509" status: 202 len: 0 microversion: 2.1 time: 0.090807 Apr 07 17:42:36.505614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 965/1793] 10.222.0.26 () {58 vars in 1259 bytes} [Thu Apr 7 17:42:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-546378509 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 07 17:42:37.475902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:37.476485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:37.482762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:37.483208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:37.483975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:37.484407 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:37.614327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:37.622142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4d02e5ef-d730-4e87-ac88-1bf102c20902 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150738 Apr 07 17:42:37.622941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 829/1794] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:37 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:38.640045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:38.640644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:38.648439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:38.648894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:38.649699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:38.650141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:38.795084 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:38.804383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e9849587-690b-4c24-9e72-43c49b4c6bfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.168157 Apr 07 17:42:38.804974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 966/1795] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:38 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:39.822107 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:39.822809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:39.829020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:39.829505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:39.830296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:39.830733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:40.037689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:40.048893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1c044aa3-f0a9-43e7-a328-a63c998a5e6a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.230909 Apr 07 17:42:40.050461 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 830/1796] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:39 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:41.067047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:41.067770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:41.074185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:41.074637 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:41.075469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:41.075903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:41.208843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:41.217325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-75571bb4-5eb9-455c-8e67-872ab38bf379 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154173 Apr 07 17:42:41.217992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 967/1797] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:41 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:42.235569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:42.236176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:42.243312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:42.243790 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:42.244562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:42.244994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:42.384792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:42.394349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-501c2618-84c7-47da-a6e2-a65860fe0bc3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.162541 Apr 07 17:42:42.394922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 831/1798] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:42 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:43.413757 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:43.414469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:43.421877 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:43.422337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:43.423122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:43.423563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:43.557665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:43.567890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f25f5f75-32ad-4906-bbde-521a639be151 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.159385 Apr 07 17:42:43.569394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 968/1799] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:43 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:44.585281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:44.587547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:44.593975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:44.594425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:44.595187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:44.595621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:44.776737 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:44.784630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c79e9b08-4a92-4418-b952-0de4eb3c26b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.203336 Apr 07 17:42:44.785218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 832/1800] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:44 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:45.801973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:45.805361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:45.809501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:45.809951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:45.810723 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:45.811161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:45.951954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:45.960897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c42be6f9-752b-453d-b80c-4e42d7d3d73a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.162833 Apr 07 17:42:45.962910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 969/1801] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:45 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:46.978239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:46.978847 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:46.985082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:46.985560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:46.986319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:46.986759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:47.118922 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:47.126581 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-485a5e79-fb0a-4394-8aef-72edd6a39f7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152267 Apr 07 17:42:47.127185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 833/1802] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:46 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:48.144290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:48.144899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:48.152011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:48.152454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:48.153242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:48.153675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:48.284727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:48.292871 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4fc91256-c143-413c-b701-2eb7af8068e8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152692 Apr 07 17:42:48.293479 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 970/1803] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:48 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:49.310280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:49.310917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:49.317181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:49.317636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:49.318395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:49.319655 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:49.460917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:49.468884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b89bfa3a-a5a1-48d2-b7c9-ee7e38648af1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.162459 Apr 07 17:42:49.469525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 834/1804] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:49 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:50.487117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:50.487737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:50.494220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:50.494673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:50.495447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:50.495887 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:50.624212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:50.632542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-780f3b27-a5d1-430c-8724-7254e213c141 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149287 Apr 07 17:42:50.633104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 971/1805] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:50 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:51.651088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:51.651703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:51.658028 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:51.658496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:51.659253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:51.659691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:51.792042 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:51.799670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-51ee8467-c4ae-4043-a987-5feb85f71665 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152457 Apr 07 17:42:51.800233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 835/1806] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:51 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:52.817702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:52.818870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:52.825228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:52.825681 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:52.826440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:52.826879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:52.958878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:52.967604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b667ce71-e864-4bb5-b60b-74a3f51de9e1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153768 Apr 07 17:42:52.968164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 972/1807] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:52 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:53.985571 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:53.986187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:53.992477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:53.992916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:53.993703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:53.994132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:54.127478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:54.135310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-99b57e09-6b13-49b2-aaff-1ef184a8c308 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153628 Apr 07 17:42:54.135865 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 836/1808] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:53 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:55.152649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:55.153307 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:55.159589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:55.160036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:55.160801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:55.161271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:55.292026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:55.299747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-eee98260-4153-4754-888a-5e6c2f2522cd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150987 Apr 07 17:42:55.300306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 973/1809] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:55 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:56.317146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:56.317767 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:56.324080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:56.324523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:56.325306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:56.325736 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:56.455116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:56.463536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8a457d6d-ede5-4bcb-891a-cd555035984e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150263 Apr 07 17:42:56.464105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 837/1810] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:56 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:57.480332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:57.480954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:57.487424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:57.487867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:57.488632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:57.489063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:57.624761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:57.633672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-10f30648-38f4-4274-8874-90b2590dbd14 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157183 Apr 07 17:42:57.634235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 974/1811] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:57 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:58.651876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:58.652486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:58.658828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:58.659266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:58.660018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:58.660442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:58.791292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:58.798919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0dd6c79d-34b1-4df0-9615-7d073686b4d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151136 Apr 07 17:42:58.799481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 838/1812] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:58 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:42:59.816142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:42:59.816686 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:42:59.824165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:59.824607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:59.825385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:42:59.825818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:42:59.958446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:42:59.967063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ed31ec83-a9a8-44c3-94b9-d3e8709f6ed8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154817 Apr 07 17:42:59.967624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 975/1813] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:42:59 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:00.984613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:00.985269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:00.992173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:00.992621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:00.993400 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:00.993830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:01.135287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:01.143529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-931daa58-39e9-45f3-9413-27eae02d6ac5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.162695 Apr 07 17:43:01.144099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 839/1814] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:00 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:02.160978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:02.162217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:02.168646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:02.169100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:02.169898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:02.170341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:02.299374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:02.307128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ce0dcd4b-0423-4e67-85cd-946d1855d7ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149997 Apr 07 17:43:02.307691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 976/1815] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:02 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:03.324580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:03.325208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:03.331575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:03.332019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:03.332776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:03.333238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:03.469508 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:03.477858 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5459022c-3963-4053-81a8-25c155a2f734 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157424 Apr 07 17:43:03.478432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 840/1816] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:03 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:04.495291 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:04.495958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:04.502537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:04.502982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:04.503744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:04.504179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:04.635034 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:04.642984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-313ae348-dba0-4fa6-be88-81713e740a8e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151628 Apr 07 17:43:04.643550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 977/1817] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:04 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:05.660498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:05.662525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:05.668419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:05.668868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:05.669679 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:05.670116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:05.806098 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:05.813861 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6499fa72-ff50-4098-8f95-8bc6dd967f7b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157240 Apr 07 17:43:05.814420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 841/1818] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:05 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:06.830782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:06.831389 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:06.838042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:06.838484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:06.839241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:06.839677 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:06.970217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:06.979127 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-01b88bc6-3df7-4f08-81f4-f7fb20287112 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152174 Apr 07 17:43:06.979697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 978/1819] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:06 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:08.001602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:08.002188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:08.008575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:08.009024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:08.009822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:08.010260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:08.153094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:08.161058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-89fc9fe8-9dd6-4685-8f68-77ccc9e55440 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.163284 Apr 07 17:43:08.162337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 842/1820] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:07 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:09.179685 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:09.180305 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:09.186770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:09.187220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:09.188026 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:09.188482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:09.322008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:09.329720 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d122b4b6-d1d8-4157-aca5-4e2361770bc0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153985 Apr 07 17:43:09.330287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 979/1821] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:09 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:10.347136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:10.347678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:10.354155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:10.354601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:10.355365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:10.355797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:10.486363 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:10.495089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8c39a263-0394-4b37-8a2f-bc0dbc1524cf tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151931 Apr 07 17:43:10.495649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 843/1822] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:10 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:10.771039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:43:10.771245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:43:11.512380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:11.512992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:11.519612 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:11.520060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:11.520829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:11.521303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:11.652473 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:11.660270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-18cbe29a-f50e-4512-96e5-4071aaa60ca3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151769 Apr 07 17:43:11.660843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 980/1823] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:11 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:12.679004 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:12.679647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:12.685976 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:12.686428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:12.687203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:12.687647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:12.816668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:12.825194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a75279af-86ab-436d-bb02-e2e4330e898e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150184 Apr 07 17:43:12.825769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 844/1824] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:12 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:43:13.843676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:13.844294 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:13.851726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:13.852180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:13.853280 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:13.854007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:14.007018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:14.015862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a94d641e-903b-4fcf-9ab5-30db1d026080 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.176859 Apr 07 17:43:14.016435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 981/1825] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:13 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:15.036839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:15.037497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:15.043793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:15.044240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:15.045005 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:15.045469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:15.177671 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:15.185620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-375cf703-e6a3-4fae-b9ec-39eedd7a78cb tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153391 Apr 07 17:43:15.186182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 845/1826] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:15 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:16.203602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:16.204208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:16.211649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:16.212097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:16.212884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:16.213357 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:16.363660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:16.371993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-df7e32d2-6599-40e2-8293-f5588e34b84b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.172238 Apr 07 17:43:16.372560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 982/1827] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:16 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:17.390110 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:17.390694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:17.397775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:17.398215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:17.398968 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:17.399396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:17.529073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:17.537807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2f31aa9f-8f60-456e-af55-2ef2d9772b8c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151545 Apr 07 17:43:17.538364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 846/1828] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:17 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:18.556323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:18.556935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:18.562806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:18.563255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:18.564015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:18.564446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:18.693840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:18.701519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2dc40f8c-865e-45bd-9a3c-d7213e1b0fab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150251 Apr 07 17:43:18.702080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 983/1829] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:18 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:19.718515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:19.719057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:19.726024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:19.726470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:19.727240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:19.727673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:19.861774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:19.869896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-631d3467-52f3-4796-b9ac-5338fd855e7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155202 Apr 07 17:43:19.870458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 847/1830] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:19 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:20.887912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:20.888522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:20.895759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:20.896329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:20.897099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:20.897564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:21.026519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:21.034281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e655b351-96d2-4938-b8e5-97affcda86ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150254 Apr 07 17:43:21.034846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 984/1831] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:20 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:22.052573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:22.053203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:22.059526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:22.059988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:22.060738 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:22.061199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:22.196197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:22.203905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c6133943-7cb7-4215-bf42-f094de306478 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155847 Apr 07 17:43:22.204466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 848/1832] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:22 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:23.220898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:23.221508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:23.228552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:23.229000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:23.229796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:23.230228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:23.361510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:23.369314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8f646c06-61a9-4dc2-b39b-16295b1c4490 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152259 Apr 07 17:43:23.369872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 985/1833] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:23 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:24.386574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:24.387217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:24.393725 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:24.394193 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:24.395490 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:24.395935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:24.530619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:24.538848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a879b452-2006-48c5-9955-07b580cda951 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156133 Apr 07 17:43:24.539424 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 849/1834] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:24 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:25.556159 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:25.556778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:25.563124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:25.563585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:25.564362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:25.564810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:25.701172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:25.710208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0a63924e-65bd-42da-be7f-36b31c615591 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157973 Apr 07 17:43:25.710711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 986/1835] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:25 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:26.653613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:43:26.654177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:43:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:43:26.728109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:26.728714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:26.735224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:26.735706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:26.736473 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:26.736906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:26.867893 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:26.875641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f348da76-445b-4f11-965f-bf31ac5a93b8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151435 Apr 07 17:43:26.876204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 850/1836] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:26 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:27.894898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:27.895689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:27.902090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:27.902538 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:27.903304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:27.903747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:28.041120 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:28.048831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c787fcee-8737-4974-b9a5-22be2e247bcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.158124 Apr 07 17:43:28.049424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 987/1837] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:27 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:29.067445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:29.068058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:29.074546 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:29.074999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:29.075764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:29.076198 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:29.209030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:29.216841 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ba0b1297-2efd-4b82-a5aa-04f40c067dfe tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153965 Apr 07 17:43:29.217427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 851/1838] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:29 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:30.236245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:30.236858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:30.243784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:30.244237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:30.245003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:30.245466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:30.377608 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:30.386047 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-29b63f13-132a-44b5-85a1-5e4bc1296d3f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153720 Apr 07 17:43:30.386612 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 988/1839] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:30 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:31.403559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:31.404152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:31.411145 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:31.411679 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:31.412441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:31.412876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:31.543120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:31.551013 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2ac956da-dd1b-487d-a230-90f0d6f2514e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151250 Apr 07 17:43:31.551649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 852/1840] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:31 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:32.568755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:32.569382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:32.575325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:32.575772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:32.576533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:32.576971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:32.706075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:32.714716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e9a43635-cd02-4f3f-b0b0-b01935169a48 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150468 Apr 07 17:43:32.715271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 989/1841] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:32 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:33.731713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:33.732390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:33.738777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:33.740930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:33.740930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:33.740930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:33.874697 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:33.883041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5a632cec-2e8e-45fd-8f87-9e24688edea3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155340 Apr 07 17:43:33.883607 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 853/1842] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:33 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:35.164151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:35.164762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:35.170715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:35.171168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:35.171934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:35.172372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:35.304017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:35.311807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-99f10344-2a5c-4682-9217-943b375fa2b3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.414886 Apr 07 17:43:35.312372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 990/1843] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:34 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:36.329799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:36.330442 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:36.337246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:36.337691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:36.338441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:36.338867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:36.470476 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:36.479110 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-34a96901-021f-4e4e-921d-6dda480506fc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153337 Apr 07 17:43:36.479668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 854/1844] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:36 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:37.497091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:37.497721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:37.505105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:37.505577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:37.506337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:37.506773 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:37.635843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:37.643778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8e42c1a3-a169-452d-8b73-b6542999d26d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150583 Apr 07 17:43:37.644923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 991/1845] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:37 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:38.662431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:38.663044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:38.669337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:38.669798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:38.670560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:38.670992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:38.810008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:38.818086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1e811d2a-a839-4cfb-bc23-e9e7a517e4aa tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.160180 Apr 07 17:43:38.818646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 855/1846] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:38 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:39.836113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:39.837103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:39.844021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:39.844471 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:39.845284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:39.845739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:39.977548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:39.985214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d173fa70-f1da-4f94-b1dd-656f209ec3f1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153701 Apr 07 17:43:39.985778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 992/1847] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:39 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:41.003023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:41.003671 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:41.009961 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:41.010410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:41.011176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:41.011616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:41.141818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:41.150229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-78476777-4c3a-49b3-ba10-2b39e66ec97f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151067 Apr 07 17:43:41.150855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 856/1848] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:40 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:42.167983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:42.168594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:42.174927 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:42.176151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:42.176966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:42.177430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:42.313196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:42.321321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fc7e3008-0605-438a-933c-d9b14e3101c4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157201 Apr 07 17:43:42.321889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 993/1849] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:42 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:43.338631 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:43.339231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:43.345557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:43.345999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:43.346748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:43.347861 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:43.483387 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:43.491658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0d422f14-b86d-4ff8-9485-6d7e99804742 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156849 Apr 07 17:43:43.492219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 857/1850] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:43 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:44.509350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:44.509991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:44.516514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:44.516960 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:44.517748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:44.518184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:44.652995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:44.661335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b716e0f3-dc12-43cc-b891-3f617da61dcd tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155836 Apr 07 17:43:44.661896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 994/1851] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:44 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:45.679157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:45.679735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:45.686087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:45.686538 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:45.687296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:45.687735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:45.818189 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:45.825892 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3dedd2de-3927-44e2-8b5b-6e800a6caf79 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151129 Apr 07 17:43:45.826478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 858/1852] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:45 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:46.843758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:46.844378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:46.850798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:46.851246 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:46.852007 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:46.852444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:46.981082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:46.989768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-71d704cd-1ae9-48ca-b129-c4e6112d2ce9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149886 Apr 07 17:43:46.990330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 995/1853] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:46 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:48.006394 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:48.007007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:48.013266 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:48.013718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:48.014480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:48.014912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:48.148690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:48.156350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3b4ed26d-1f8d-4c8a-969c-69a828b33ffc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153881 Apr 07 17:43:48.156905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 859/1854] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:48 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:49.173791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:49.174401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:49.181054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:49.181527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:49.182292 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:49.182727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:49.313947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:49.321859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f2ace25a-50aa-4a62-876e-2e5e648dc7d6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151944 Apr 07 17:43:49.322420 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 996/1855] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:49 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:50.339706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:50.340317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:50.346612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:50.348012 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:50.348800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:50.349257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:50.483293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:50.493603 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cec6f2ac-2f0f-4b7b-80f7-f3a13f82d1e4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157659 Apr 07 17:43:50.494180 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 860/1856] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:50 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:51.511134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:51.511799 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:51.518401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:51.518873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:51.519649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:51.520081 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:51.648762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:51.656520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-22f6b649-ec5b-49d3-a78e-7595b56bc49d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149257 Apr 07 17:43:51.657079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 997/1857] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:51 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:52.674590 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:52.675249 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:52.681658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:52.682105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:52.682873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:52.683308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:52.814928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:52.822765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-28aa8903-3782-496d-8c6e-67b3018f0a04 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152018 Apr 07 17:43:52.823337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 861/1858] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:52 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:53.839966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:53.840500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:53.848852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:53.849325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:53.850080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:53.850519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:53.981460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:53.989761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-46cc1eeb-99cd-4b74-8900-b8e19d3bd60a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153776 Apr 07 17:43:53.990323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 998/1859] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:53 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:55.007072 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:55.007675 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:55.013871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:55.014313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:55.015062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:55.015487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:55.147956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:55.155715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-42c33bd3-b35c-4fc2-a46c-6d9f4f5e56b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152673 Apr 07 17:43:55.156277 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 862/1860] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:55 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:56.174104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:56.174847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:56.181217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:56.181663 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:56.182424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:56.182854 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:56.544873 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:56.553215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-da0eb075-dbdb-4e3b-aad3-b77438d675d4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.382956 Apr 07 17:43:56.553771 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 999/1861] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:56 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:57.571072 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:57.571765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:57.578270 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:57.578720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:57.579491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:57.579928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:57.717598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:57.726357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-022ce681-e079-42cc-890f-4ac375feb0ab tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.159130 Apr 07 17:43:57.726929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 863/1862] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:57 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:58.744077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:58.744929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:58.751308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:58.751752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:58.753164 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:58.753511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:58.885032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:43:58.893072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4bf25a97-dc77-4d40-bce7-4928c485c529 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153386 Apr 07 17:43:58.894350 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1000/1863] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:58 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:43:59.911455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:43:59.911996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:43:59.918296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:59.918748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:43:59.919509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:43:59.919945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:00.050176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:00.058125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ccf10cd5-6d5d-4cf4-8578-f531b790ceb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151166 Apr 07 17:44:00.058689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 864/1864] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:43:59 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:01.075772 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:01.076505 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:01.084051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:01.084497 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:01.085286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:01.085718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:01.219690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:01.228116 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8d148c6a-744e-439b-b6d7-a3328dfd525f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156204 Apr 07 17:44:01.228796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1001/1865] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:01 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:02.245699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:02.246302 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:02.252698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:02.253163 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:02.254638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:02.255091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:02.382931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:02.390640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8083e51f-dd44-45b0-b33c-046b71617009 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.148807 Apr 07 17:44:02.391555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 865/1866] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:02 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:03.408845 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:03.409507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:03.416319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:03.416768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:03.417585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:03.418021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:03.547964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:03.556314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3088ef04-1836-4709-af8f-9615df7043da tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151348 Apr 07 17:44:03.556885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1002/1867] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:03 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:04.573740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:04.574352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:04.580328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:04.580808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:04.581596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:04.582161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:04.718395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:04.726855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e1759c3f-a03d-440c-8679-9e1ead96b061 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.157193 Apr 07 17:44:04.727422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 866/1868] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:04 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:05.744704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:05.745339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:05.751690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:05.752596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:05.752884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:05.753348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:05.885727 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:05.894078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9c15a85a-ed52-40c2-b7bf-5f6b34b7e0db tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153336 Apr 07 17:44:05.895281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1003/1869] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:05 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:06.912608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:06.913129 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:06.919575 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:06.920023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:06.920788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:06.921259 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:07.058271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:07.063784 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ffb9eb10-841b-43ab-9e2b-35d830253aa3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155835 Apr 07 17:44:07.064341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 867/1870] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:06 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:08.081180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:08.081860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:08.088825 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:08.089317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:08.090085 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:08.090527 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:08.219599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:08.227964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4eb0835c-a985-469e-8b0c-c80bc2650180 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150722 Apr 07 17:44:08.228529 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1004/1871] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:08 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:09.245161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:09.245766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:09.252010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:09.252445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:09.253227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:09.254446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:09.385520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:09.393626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f0125232-2fa0-417e-956c-61343624cc11 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152360 Apr 07 17:44:09.394359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 868/1872] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:09 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:10.411998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:10.412649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:10.418906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:10.419357 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:10.420115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:10.420545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:10.555334 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:10.562988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6778d6e8-4ecb-4d1c-9e89-8dd835d9e5ed tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155425 Apr 07 17:44:10.563552 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1005/1873] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:10 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:11.579698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:11.580304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:11.587390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:11.587837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:11.588595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:11.589030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:11.719615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:11.727983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-09d18c91-1dbd-4c60-a968-e2487fabfb3e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152170 Apr 07 17:44:11.728544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 869/1874] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:11 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:12.745411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:12.746030 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:12.752335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:12.752792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:12.754199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:12.754803 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:12.889672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:12.897930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-22571812-80d1-45fe-ad59-ad770e26190a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156412 Apr 07 17:44:12.898501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1006/1875] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:12 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:13.914920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:13.915564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:13.925492 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:13.926225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:13.927573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:13.928291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:14.151349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:14.159619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cd076eb5-735f-4d4d-aa8a-aeffaf939f17 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.248573 Apr 07 17:44:14.160251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 870/1876] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:13 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:15.176926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:15.177579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:15.183855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:15.184302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:15.185097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:15.185556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:15.320437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:15.328264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-964bfd4d-10f1-4f22-835b-79c7ccd6d5d5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.155240 Apr 07 17:44:15.328830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1007/1877] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:15 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:16.346374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:16.347070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:16.353710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:16.354165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:16.354965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:16.355404 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:16.484096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:16.492533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-43ccf91a-ca6b-4397-9955-27cdd823f6f4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150003 Apr 07 17:44:16.493108 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 871/1878] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:16 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:17.509698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:17.510310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:17.516886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:17.517379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:17.518150 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:17.519163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:17.650999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:17.658783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3f44d662-f6f1-48da-bff6-7f1d5af368bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152926 Apr 07 17:44:17.659354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1008/1879] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:17 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:18.676669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:18.677337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:18.683789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:18.684239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:18.685003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:18.685475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:18.818605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:18.826397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7d18e2ee-7fc9-479f-9390-00707f01c78f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.154299 Apr 07 17:44:18.826967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 872/1880] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:18 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:19.843833 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:19.844353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:19.851746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:19.852194 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:19.852954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:19.853415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:19.983789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:19.992598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-81ef0ef0-fb97-4f6e-96ad-40533d46495c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152698 Apr 07 17:44:19.993179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1009/1881] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:19 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:21.010250 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:21.010881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:21.017393 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:21.017840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:21.019721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:21.020158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:21.155229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:21.162972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b247d700-ec34-4874-8b83-758dbb162f08 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.156563 Apr 07 17:44:21.163554 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 873/1882] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:21 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:22.180982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:22.181617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:22.188088 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:22.188571 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:22.189375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:22.189816 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:22.320437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:22.328205 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e13ef0f6-c4c7-4de1-82af-26a4a8446109 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151094 Apr 07 17:44:22.328777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1010/1883] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:22 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:23.345828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:23.346440 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:23.352749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:23.353228 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:23.353995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:23.354432 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:23.486935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:23.495143 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a91eac5a-3619-4054-b921-50a58d06af95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153192 Apr 07 17:44:23.495706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 874/1884] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:23 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:24.513653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:24.514250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:24.521446 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:24.521897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:24.522660 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:24.523095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:24.652385 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:24.660758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a1e64948-b289-4ab0-b56a-fa878786eff3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151000 Apr 07 17:44:24.661340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1011/1885] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:24 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:25.677672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:25.678282 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:25.684984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:25.685455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:25.686224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:25.686653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:25.818736 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:25.826511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9424ba73-5899-48e1-872c-0b0a5d423fe7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.153515 Apr 07 17:44:25.827071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 875/1886] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:25 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:26.844965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:26.845615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:26.851916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:26.852366 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:26.853130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:26.853595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:26.983594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:26.991299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3fed8a36-67b5-4b70-a1d0-b2aae6dc13a5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150190 Apr 07 17:44:26.991868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1012/1887] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:26 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:28.008942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:28.009582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:28.016323 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:28.016775 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:28.017578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:28.018655 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:28.147709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:28.155411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1f08a1b6-005b-4a53-957c-93701b06f9e9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.150320 Apr 07 17:44:28.155966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 876/1888] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:28 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:29.173193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:29.173845 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:29.181039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:29.181528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:29.182300 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:29.182743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:29.319574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:29.327308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2f1df9f6-7f57-4115-9c53-564e30e6b661 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.158067 Apr 07 17:44:29.327881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1013/1889] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:29 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:30.345271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:30.345910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:30.352376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:30.352822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:30.353610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:30.354044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:30.482808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:30.491118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-16691fa7-1ce0-454b-b52b-71f12a47acd9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.149738 Apr 07 17:44:30.491686 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 877/1890] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:30 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:31.508133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:31.508777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:31.514806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:31.515258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:31.516277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:31.516716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:31.648298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:31.656143 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-84e4acc6-2067-46a1-89e0-2631f8d4a571 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.151938 Apr 07 17:44:31.656714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1014/1891] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:31 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:32.674095 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:32.674705 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:32.682042 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:32.682487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:32.683237 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:32.683670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:32.814836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:32.823055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-aea44f2c-d6e6-4bcb-a9ad-d887fc4ddf41 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.152844 Apr 07 17:44:32.823614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 878/1892] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:32 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:33.840570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:33.841189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:33.847726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:33.848174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:33.848930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:33.849390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:33.863853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:44:33.864546 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 (ip 10.222.0.26) !!! Apr 07 17:44:33.987039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:33.995339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8d1dc1ea-29ac-437a-be58-d40e6b67e502 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.158588 Apr 07 17:44:33.995908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1015/1893] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:33 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:35.012289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:35.012900 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:35.019470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:35.019915 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:35.020668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:35.021097 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:35.158159 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:35.166692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-730fda39-c405-4f8f-b23b-06d03c2573ca tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.158387 Apr 07 17:44:35.167256 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 879/1894] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:35 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:36.184915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:36.185568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:36.192553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:36.193005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:36.193812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:36.194254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:36.332142 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:36.340470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a946802b-3302-4b17-a625-41048fbfded7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1560 microversion: 2.1 time: 0.159523 Apr 07 17:44:36.341042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1016/1895] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:36 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:37.356781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:37.357454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:37.364727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:37.365203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:37.366105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:37.366532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:37.441219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:37.441219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-139ab2ea-c60f-457a-b8e1-3fb8bd872fb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1518 microversion: 2.1 time: 0.086665 Apr 07 17:44:37.441219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 880/1896] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:37 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1518 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:37.445870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-11523e15-42d9-4374-b805-68235f82dd7b req-53dec94d-6699-4093-b1e1-92365ed33fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3", "name": "network-vif-deleted", "tag": "460f0c0e-20d7-48e1-b7d2-e771eec9c91c"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:44:37.453957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-11523e15-42d9-4374-b805-68235f82dd7b req-53dec94d-6699-4093-b1e1-92365ed33fd1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:37.454400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-11523e15-42d9-4374-b805-68235f82dd7b req-53dec94d-6699-4093-b1e1-92365ed33fd1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:37.464965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-11523e15-42d9-4374-b805-68235f82dd7b req-53dec94d-6699-4093-b1e1-92365ed33fd1 service nova] Creating event network-vif-deleted:460f0c0e-20d7-48e1-b7d2-e771eec9c91c for instance fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 on hv-cinder-83699 Apr 07 17:44:37.470840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-11523e15-42d9-4374-b805-68235f82dd7b req-53dec94d-6699-4093-b1e1-92365ed33fd1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088669 Apr 07 17:44:37.471499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1017/1897] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:44:38.456741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:38.457368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:38.463709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:38.464151 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:38.464941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:38.465395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:38.525739 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:38.533629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2e3362ce-a72f-42ef-8090-bfd1d771b643 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081194 Apr 07 17:44:38.534981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 881/1898] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:38 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:39.553196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:39.556051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:39.559998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:39.560447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:39.561244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:39.561684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:39.624979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:39.633128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1bef240f-2036-40d5-8109-3897476d81a0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.085390 Apr 07 17:44:39.633710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1018/1899] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:39 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:40.650372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:40.651018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:40.657435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:40.657894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:40.658662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:40.659104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:40.717818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:40.725817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b93a6b64-9827-471b-bfe3-58ac7d5e1097 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079342 Apr 07 17:44:40.726382 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 882/1900] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:40 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:41.743371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:41.743919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:41.750228 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:41.750679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:41.751442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:41.751878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:41.810614 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:41.818911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7208f5e8-9550-43d1-8c57-6c4fb6e44c72 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079481 Apr 07 17:44:41.819467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1019/1901] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:41 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:42.836499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:42.837112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:42.843409 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:42.843856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:42.844617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:42.845048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:42.903426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:42.911807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-463cff10-a4ae-48ea-a4d5-3320d2065d5b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079307 Apr 07 17:44:42.912361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 883/1902] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:42 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:44:43.928768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:43.929434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:43.935740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:43.936187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:43.936949 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:43.937414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:43.998048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:44.006317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d443e4b5-8895-410d-aacc-8097ed0c4af8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081490 Apr 07 17:44:44.006877 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1020/1903] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:43 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:45.023709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:45.024326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:45.030698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:45.031157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:45.031924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:45.032365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:45.095405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:45.099721 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8b9d134d-d198-4e4f-999e-344ad6be04c3 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079865 Apr 07 17:44:45.100292 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 884/1904] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:45 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:46.117547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:46.118155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:46.124449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:46.124892 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:46.125667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:46.126100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:46.187776 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:46.196608 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8b4eeab9-1dca-4633-929e-6866d54d6eff tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082961 Apr 07 17:44:46.197179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1021/1905] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:46 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:47.213894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:47.214500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:47.220791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:47.221809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:47.222613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:47.223074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:47.282499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:47.289578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3a79987a-45bb-4e1e-9d7e-de4e43924245 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079561 Apr 07 17:44:47.290148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 885/1906] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:47 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:48.306642 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:48.307259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:48.313510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:48.313955 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:48.314708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:48.316248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:48.374563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:48.383526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b1b8616d-afc2-4a2b-a240-6cf09f874814 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080786 Apr 07 17:44:48.384106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1022/1907] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:48 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:49.401219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:49.401853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:49.408108 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:49.408938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:49.409724 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:49.410157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:49.473781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:49.481566 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-261a5d21-e96b-4aea-8bce-18d0b460014e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.084183 Apr 07 17:44:49.482141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 886/1908] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:49 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:50.498351 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:50.498966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:50.505377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:50.505832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:50.506602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:50.507045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:50.565486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:50.573257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-472a317b-a601-45d5-b4ba-dbdd7e3233c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078716 Apr 07 17:44:50.573830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1023/1909] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:50 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:51.590879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:51.591480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:51.599023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:51.599466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:51.600218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:51.600647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:51.659254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:51.666965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b250391d-1c48-4804-906b-26c11ca5562a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079940 Apr 07 17:44:51.667519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 887/1910] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:51 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:52.687301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:52.687945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:52.694961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:52.695411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:52.696175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:52.696612 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:52.759288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:52.767341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8266d41d-29c1-47b5-bee6-48ae00d00e13 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.083945 Apr 07 17:44:52.767993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1024/1911] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:52 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:53.783998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:53.784533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:53.790842 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:53.791289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:53.792049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:53.792484 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:53.851106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:53.858850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-52031f8a-5ae8-4727-9234-f7d0bba92838 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078920 Apr 07 17:44:53.859412 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 888/1912] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:53 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:54.875860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:54.876469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:54.883912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:54.884356 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:54.885108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:54.885564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:54.944556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:54.952234 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-93a432ae-59bb-4747-954e-6b85c9795fde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080177 Apr 07 17:44:54.952789 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1025/1913] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:54 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:55.969826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:55.970459 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:55.977831 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:55.978271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:55.979028 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:55.979464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:56.038683 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:56.046330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c4e6bea6-dd2e-4e01-999a-94b93b80f4c9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080437 Apr 07 17:44:56.046889 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 889/1914] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:55 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:57.063522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:57.064160 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:57.070942 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:57.071384 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:57.072136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:57.072566 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:57.131897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:57.139688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-28efdfb6-03dc-4688-a539-9cc2d9521fec tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080004 Apr 07 17:44:57.140243 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1026/1915] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:57 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:58.156564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:58.157200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:58.164106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:58.164555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:58.165352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:58.165791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:58.223853 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:58.231439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-821ca712-52ee-4f3d-8c0f-bdad77d520a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078943 Apr 07 17:44:58.231999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 890/1916] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:58 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:44:58.612376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:44:58.612950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:44:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:44:59.248817 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:44:59.249444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:44:59.256251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:59.256693 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:59.257482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:44:59.257916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:44:59.445472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:44:59.453441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aa76ac54-586b-4a2f-b1c5-186c14e52cb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.208541 Apr 07 17:44:59.454008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1027/1917] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:44:59 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:00.471580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:00.472197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:00.478484 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:00.478927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:00.479678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:00.480106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:00.539328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:00.546874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-542a9579-2686-4fd0-9b62-8d32caf0dab4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080142 Apr 07 17:45:00.547426 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 891/1918] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:00 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:01.565848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:01.566494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:01.572392 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:01.572858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:01.573649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:01.574089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:01.633125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:01.641129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c0746aa8-e7ef-44ea-9103-ff8836c5f8a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079954 Apr 07 17:45:01.641714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1028/1919] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:01 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:02.659472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:02.660088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:02.666384 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:02.666830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:02.667583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:02.668015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:02.729654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:02.737783 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c406aff2-65ae-4108-857e-4c02fa2948b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.083363 Apr 07 17:45:02.738341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 892/1920] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:02 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:03.754724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:03.755263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:03.761656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:03.762107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:03.762874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:03.763315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:03.822220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:03.830644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-26878f5e-66b8-4012-8063-f46523ad4e95 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079390 Apr 07 17:45:03.831212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1029/1921] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:03 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:04.848368 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:04.848888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:04.854774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:04.855232 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:04.855978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:04.856411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:04.915522 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:04.923216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-da4d0d67-10d9-42c0-9c04-15eca9719e3d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079678 Apr 07 17:45:04.924423 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 893/1922] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:04 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:05.941304 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:05.941965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:05.948184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:05.948628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:05.949405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:05.949838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:06.011319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:06.020404 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cb34e862-7706-4acd-82ad-e7b1d341394c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.083900 Apr 07 17:45:06.020977 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1030/1923] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:05 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:07.039147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:07.039760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:07.045940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:07.053947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:07.053947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:07.053947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:07.106807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:07.114609 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5b538c6a-5517-4742-aab0-8d87c0a79b8f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079793 Apr 07 17:45:07.115172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 894/1924] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:07 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:08.131348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:08.132074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:08.139195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:08.139662 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:08.140679 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:08.141117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:08.201551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:08.210395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cca21d52-264d-4d87-beef-0870b6e92621 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082886 Apr 07 17:45:08.210954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1031/1925] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:08 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:09.227343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:09.227963 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:09.234243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:09.238244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:09.238244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:09.238244 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:09.295602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:09.304136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a7c0d4c3-c257-491e-b43a-69c0b1a46c16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080691 Apr 07 17:45:09.304703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 895/1926] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:09 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:10.321286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:10.321900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:10.328140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:10.328588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:10.330024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:10.330491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:10.387752 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:10.396452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-41a314ed-1aeb-4477-acf0-53852cd6560c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079038 Apr 07 17:45:10.397012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1032/1927] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:10 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:11.414238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:11.414903 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:11.421243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:11.421698 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:11.422457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:11.422897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:11.482428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:11.490326 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5c175c7d-d2ee-44b2-b3ab-98b96ef7222c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079968 Apr 07 17:45:11.490887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 896/1928] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:11 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:12.507302 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:12.507913 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:12.514174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:12.514625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:12.515646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:12.516086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:12.578417 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:12.586226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dac0e1c9-8a49-4441-abe0-ad02ce209bb7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082848 Apr 07 17:45:12.586782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1033/1929] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:12 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:12.713512 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:45:12.713967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:45:13.602727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:13.606497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:13.609589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:13.610039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:13.610809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:13.611243 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:13.671468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:13.679838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4ea43bd5-583e-498c-ab42-8c66ffd0e43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080913 Apr 07 17:45:13.680420 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 897/1930] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:13 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:14.696996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:14.697630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:14.703883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:14.704369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:14.705122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:14.705576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:14.771697 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:14.779766 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6cd9d130-5a9e-47ac-96af-49224093ff65 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.086637 Apr 07 17:45:14.780335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1034/1931] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:14 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:15.796777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:15.797417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:15.804260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:15.804708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:15.805527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:15.805960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:15.898273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:15.905905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-887953f8-3def-40c1-b0dd-93092bb286d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.112950 Apr 07 17:45:15.906469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 898/1932] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:15 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:16.924403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:16.925011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:16.931395 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:16.931842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:16.932604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:16.933042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:16.995297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:17.003238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e33df755-ef62-47cd-a6a4-c5618d49e4b1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.083286 Apr 07 17:45:17.003797 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1035/1933] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:16 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:18.021267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:18.021890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:18.028482 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:18.028923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:18.029701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:18.030136 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:18.090080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:18.097837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bad36452-8ac3-4492-be34-182c8e6bd5a6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081146 Apr 07 17:45:18.098398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 899/1934] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:18 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:19.115317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:19.115933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:19.122455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:19.122912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:19.123689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:19.124129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:19.184251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:19.192980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1f9f1cc2-4458-407e-ad21-928ef0aca4c8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081561 Apr 07 17:45:19.193615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1036/1935] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:19 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:20.210759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:20.211441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:20.218254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:20.218812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:20.220167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:20.220776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:20.279804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:20.288145 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-08dbfc2d-b3c6-43a8-836c-6665fcd82b16 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081360 Apr 07 17:45:20.288700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 900/1936] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:20 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:21.305092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:21.305745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:21.312042 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:21.312496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:21.313957 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:21.314420 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:21.371970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:21.380423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2de9800f-234e-4954-b461-00d5c7a294be tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079241 Apr 07 17:45:21.380987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1037/1937] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:21 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:22.398077 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:22.398669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:22.405004 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:22.405479 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:22.406239 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:22.406676 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:22.464653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:22.472456 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d9e658b1-cdd7-43af-8f91-f7e11d84a363 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078273 Apr 07 17:45:22.473011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 901/1938] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:22 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:23.490204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:23.490839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:23.497083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:23.497553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:23.498309 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:23.498739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:23.564274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:23.571969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e38849f0-81eb-4acd-96aa-e5b71931c3a2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.085661 Apr 07 17:45:23.572528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1038/1939] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:23 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:24.589643 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:24.590253 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:24.596715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:24.597176 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:24.597945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:24.598379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:24.657796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:24.665597 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9499c186-86ec-4cd9-9a09-042a4f7d186e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079825 Apr 07 17:45:24.666153 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 902/1940] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:24 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:25.682659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:25.683272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:25.690109 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:25.690555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:25.691316 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:25.691748 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:25.750092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:25.757986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-218dae07-5908-4e29-972a-8d2e5bb843bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079138 Apr 07 17:45:25.758496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1039/1941] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:25 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:45:26.776015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:26.776629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:26.783937 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:26.784382 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:26.785172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:26.785601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:26.842825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:26.850970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ad39b25-0de3-47af-b400-62e6e11e3382 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078879 Apr 07 17:45:26.851520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 903/1942] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:26 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:27.868265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:27.868785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:27.875097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:27.876186 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:27.876945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:27.877407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:27.936654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:27.944944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5cfa28e3-7daa-4b47-8895-920ba6cf2f5a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080627 Apr 07 17:45:27.945539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1040/1943] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:27 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:28.962172 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:28.962789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:28.969761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:28.970229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:28.970985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:28.971422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:29.029940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:29.038258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d78b93a4-6e12-4bfc-bc3c-72c3cc64fb15 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079967 Apr 07 17:45:29.038824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 904/1944] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:28 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:30.055749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:30.056354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:30.063180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:30.063628 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:30.064373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:30.064804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:30.126655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:30.134379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-83cb8d8c-be8b-4247-b9e1-9ebfb9dd406a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082464 Apr 07 17:45:30.134941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1041/1945] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:30 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:31.151895 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:31.152507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:31.158875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:31.159319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:31.160087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:31.160521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:31.220850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:31.228515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fe4aab6a-3cf3-4528-8694-fe2b47ccd04b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080539 Apr 07 17:45:31.229075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 905/1946] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:31 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:32.246515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:32.247128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:32.253547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:32.253990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:32.254740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:32.255166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:32.313659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:32.321452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-41993f5a-98a7-4a7c-a0b5-7decac45330d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078784 Apr 07 17:45:32.322023 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1042/1947] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:32 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:33.339048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:33.339648 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:33.345940 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:33.346384 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:33.347137 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:33.347565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:33.407050 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:33.414873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-815fc1a0-b400-4135-a618-61a26d1faa61 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079697 Apr 07 17:45:33.415424 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 906/1948] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:33 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:34.432456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:34.433066 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:34.440214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:34.440666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:34.441480 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:34.441919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:34.501001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:34.510255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a399562d-aba7-49f3-9da1-100dbe47ad1f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081658 Apr 07 17:45:34.510825 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1043/1949] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:34 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:35.527715 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:35.528323 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:35.534972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:35.535412 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:35.536160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:35.536590 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:35.600509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:35.608290 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4b4c369a-e8c1-46c3-b3be-4a385e105403 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.084414 Apr 07 17:45:35.608854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 907/1950] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:35 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:36.626049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:36.626669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:36.632967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:36.633444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:36.634205 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:36.634633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:36.697530 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:36.705409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-999d49de-c9fa-4d75-bc1c-6ff6835873e7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.084162 Apr 07 17:45:36.705977 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1044/1951] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:36 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:37.722998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:37.723611 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:37.729966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:37.730417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:37.731179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:37.731618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:37.791147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:37.799777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b59f4974-a3fe-4884-8057-8760b18ee111 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081345 Apr 07 17:45:37.800332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 908/1952] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:37 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:38.817387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:38.818394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:38.824851 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:38.825345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:38.826107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:38.826563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:38.885999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:38.895271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6de91006-2dfc-4e7e-b8bc-09c75082e3ef tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081936 Apr 07 17:45:38.895847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1045/1953] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:38 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:39.912562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:39.913126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:39.919403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:39.919855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:39.920626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:39.921057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:39.979401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:39.987823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-768b80c9-4e82-4af3-909d-46a92d9e5410 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079247 Apr 07 17:45:39.988374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 909/1954] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:39 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:41.005540 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:41.006153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:41.012554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:41.013002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:41.013814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:41.014255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:41.073627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:41.081373 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6869b06d-3f65-4af7-804c-d272cd15817e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079805 Apr 07 17:45:41.081938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1046/1955] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:41 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:42.099237 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:42.099890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:42.106224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:42.106673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:42.107433 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:42.107878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:42.169869 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:42.178160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1785970d-14b5-4566-ae0e-1f6a984427f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082763 Apr 07 17:45:42.178714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 910/1956] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:42 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:45:43.198196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:43.198806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:43.205911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:43.206358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:43.207117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:43.207549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:43.270644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:43.278308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-55947aec-3d60-4b0e-82a7-d71e072dda7f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.083984 Apr 07 17:45:43.278866 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1047/1957] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:43 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:44.295905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:44.297049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:44.303563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:44.304007 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:44.304771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:44.305233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:44.364636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:44.372343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c08d2371-4ada-4bd1-96e9-eaa439726069 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080356 Apr 07 17:45:44.372916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 911/1958] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:44 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:45.388688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:45.389340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:45.396591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:45.397040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:45.397838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:45.398272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:45.458514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:45.466277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d96c94e1-89ec-4332-93b4-5cfbd3e6e256 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081423 Apr 07 17:45:45.466848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1048/1959] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:45 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:45:46.483453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:46.484225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:46.490441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:46.490881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:46.491634 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:46.492065 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:46.551863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:46.559713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ff77c135-1840-4bda-a361-3cbad0be0173 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080098 Apr 07 17:45:46.560268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 912/1960] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:46 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:47.576173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:47.576809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:47.583861 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:47.584306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:47.585060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:47.585520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:47.647296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:47.655089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-10550cbf-8e20-498f-8a37-a38aaad7301b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082793 Apr 07 17:45:47.655796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1049/1961] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:47 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:48.672344 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:48.672958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:48.679328 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:48.679772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:48.680533 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:48.680970 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:48.739456 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:48.747112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-746b7551-0caf-4133-b8ea-41969d340bd8 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079208 Apr 07 17:45:48.747662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 913/1962] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:48 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:49.765360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:49.765967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:49.775551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:49.775551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:49.775551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:49.775551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:49.836025 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:49.844348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-33fc18b5-49df-4fb4-a7c3-b89ca0e7c472 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.083292 Apr 07 17:45:49.844910 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1050/1963] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:49 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:50.860723 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:50.861359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:50.867647 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:50.868087 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:50.868843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:50.869307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:50.927504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:50.935188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-aaee054d-f925-46e6-9180-5c0a51b07df6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078417 Apr 07 17:45:50.935742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 914/1964] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:50 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:51.951738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:51.952491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:51.958760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:51.959231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:51.959982 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:51.960413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:52.018588 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:52.026226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ff6554fb-281a-4fa8-916b-7b9887416a0d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078342 Apr 07 17:45:52.026777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1051/1965] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:51 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:53.044257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:53.044868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:53.051315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:53.051761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:53.052521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:53.052956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:53.112954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:53.120674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7e17ca18-950d-45ab-86b7-095a2f4412b5 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080261 Apr 07 17:45:53.121265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 915/1966] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:53 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:54.138310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:54.138918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:54.145630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:54.146082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:54.146839 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:54.147275 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:54.206537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:54.214386 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-846e0748-b3d7-42b9-941b-9ee329b0bfb0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079923 Apr 07 17:45:54.214952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1052/1967] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:54 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:55.231740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:55.232352 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:55.239371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:55.239817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:55.240578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:55.241014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:55.299489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:55.307345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4c5be63e-15ba-4daf-8713-2676d10c0ed4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079475 Apr 07 17:45:55.307912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 916/1968] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:55 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:56.324454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:56.325061 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:56.331884 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:56.332325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:56.333078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:56.333535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:56.397299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:56.404916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0739ac6e-ceb2-4d62-aff9-3539524af90d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.084295 Apr 07 17:45:56.406591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1053/1969] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:56 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:57.424052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:57.424654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:57.431043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:57.431519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:57.432275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:57.432710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:57.492487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:57.500762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-32fb3a37-f3ef-443f-9baf-a86a12bef2a9 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081758 Apr 07 17:45:57.501345 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 917/1970] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:57 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:58.518077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:58.518611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:58.524826 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:58.526508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:58.526508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:58.526508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:58.584932 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:58.592684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6531c96a-d03c-404a-9087-83b893aae090 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078902 Apr 07 17:45:58.593285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1054/1971] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:58 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:45:59.610254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:45:59.610897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:45:59.617366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:59.617813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:59.618578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:45:59.619009 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:45:59.680403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:45:59.688830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9e790c35-5128-4e36-ac82-4d7d17e6005d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082420 Apr 07 17:45:59.689449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 918/1972] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:45:59 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:00.706482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:00.707090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:00.713380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:00.713827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:00.714582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:00.715010 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:00.778806 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:00.788057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6fcf0a68-fa61-4ad1-9852-ec7bbffa2fa7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.085796 Apr 07 17:46:00.788645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1055/1973] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:00 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:01.805388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:01.805948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:01.812321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:01.812886 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:01.813709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:01.814148 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:01.874020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:01.881749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-aeac35bf-ed51-4525-88e6-459041149482 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080373 Apr 07 17:46:01.882325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 919/1974] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:01 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:02.899493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:02.900104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:02.906242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:02.907223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:02.908096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:02.908533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:02.970114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:02.977872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-56eda86c-7a2c-4409-aedc-dc8ef30ddd6b tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082269 Apr 07 17:46:02.978433 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1056/1975] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:02 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:03.994379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:03.994985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:04.001911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:04.002357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:04.003117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:04.003545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:04.061628 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:04.070711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3f5b2ff2-a6e5-496e-8db2-8d25606132ae tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080217 Apr 07 17:46:04.071273 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 920/1976] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:03 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:05.088456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:05.089070 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:05.095520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:05.095975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:05.096742 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:05.097208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:05.156734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:05.164599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-628bed87-4e95-4668-a6fb-82477d29e6b2 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079969 Apr 07 17:46:05.168429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1057/1977] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:05 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:06.182306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:06.182911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:06.190777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:06.191225 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:06.191990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:06.192425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:06.250537 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:06.258186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eaf73565-5e9d-4031-8ccf-8df4a44afbb1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079798 Apr 07 17:46:06.258756 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 921/1978] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:06 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:07.275586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:07.276199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:07.283267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:07.283719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:07.284482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:07.284920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:07.342718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:07.351431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-27414b69-9bb5-46c9-b821-6681f084dea0 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079746 Apr 07 17:46:07.351992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1058/1979] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:07 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:08.367826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:08.368437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:08.375215 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:08.376199 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:08.376966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:08.377425 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:08.439038 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:08.446635 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c9c841eb-101b-4781-9fcd-62d78a3eb6bc tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082710 Apr 07 17:46:08.447198 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 922/1980] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:08 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:09.463774 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:09.464419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:09.471429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:09.471883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:09.472649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:09.473088 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:09.534001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:09.541787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0074a40a-69a0-47ec-9037-5b4859463408 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081881 Apr 07 17:46:09.542354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1059/1981] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:09 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:10.558935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:10.559567 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:10.566475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:10.566923 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:10.567685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:10.568118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:10.626419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:10.634029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a1e6a504-1fda-4343-95fc-b9e1f41db8c1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078986 Apr 07 17:46:10.634583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 923/1982] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:10 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:11.652539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:11.653569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:11.660118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:11.660562 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:11.661353 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:11.661791 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:11.722995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:11.730759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-40b58b35-4017-43d4-a39e-d328d00e8432 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082134 Apr 07 17:46:11.731321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1060/1983] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:11 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:12.748749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:12.749460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:12.756369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:12.756813 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:12.757633 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:12.758065 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:12.819322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:12.827131 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f038f196-4630-4493-9031-25f2b0cb0fd6 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082236 Apr 07 17:46:12.828754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 924/1984] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:12 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:13.845103 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:13.845692 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:13.852095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:13.852551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:13.853352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:13.853801 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:13.913049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:13.920849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-94e367a8-dd0c-40cb-baa4-2c0e1edb4db1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080358 Apr 07 17:46:13.922184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1061/1985] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:13 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:14.939191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:14.939797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:14.947128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:14.947588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:14.948361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:14.948798 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:15.020604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:15.029280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ea41fb7c-3f81-45ad-b84b-0fa34a9cc2f7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.093995 Apr 07 17:46:15.029848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 925/1986] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:14 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:16.048374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:16.049052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:16.057711 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:16.058414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:16.059516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:16.060181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:16.125482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:16.133242 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e909e515-ad30-4952-9270-49c6e9887024 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.089375 Apr 07 17:46:16.133821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1062/1987] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:16 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:17.150661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:17.151276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:17.157703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:17.158149 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:17.158914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:17.159351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:17.218517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:17.226252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-51dc6392-488f-48e6-ac91-f5f24e5ea43d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079616 Apr 07 17:46:17.226817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 926/1988] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:17 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:18.244110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:18.244651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:18.251576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:18.252024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:18.252785 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:18.253259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:18.311403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:18.319687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9c1a2ced-df43-454b-b291-5c750466ced7 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079615 Apr 07 17:46:18.320284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1063/1989] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:18 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:19.337572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:19.338184 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:19.345049 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:19.345527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:19.346331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:19.346766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:19.404854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:19.413190 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eea1df04-02e0-4676-8a6e-1280178a033c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079491 Apr 07 17:46:19.413749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 927/1990] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:19 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:20.429569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:20.430175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:20.436518 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:20.436964 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:20.438318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:20.438883 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:20.496639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:20.504918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-af1bfd89-735d-4965-bf96-796920ba2434 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079225 Apr 07 17:46:20.505507 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1064/1991] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:20 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:21.522480 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:21.523112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:21.529418 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:21.529866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:21.530618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:21.531056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:21.594860 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:21.602604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1ad44242-1010-4522-b2ff-c4c3c43e6415 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.084002 Apr 07 17:46:21.603167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 928/1992] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:21 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:22.619658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:22.620264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:22.626985 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:22.627426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:22.628179 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:22.628613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:22.687145 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:22.695631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7fa63bdd-e46a-4888-9c8c-cd1b4333da2a tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079800 Apr 07 17:46:22.696187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1065/1993] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:22 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:23.712523 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:23.713186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:23.719997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:23.720456 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:23.721265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:23.721708 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:23.780348 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:23.789021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ad1cb1ab-0014-4dd1-b089-89d59a78e25c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.080302 Apr 07 17:46:23.789555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 929/1994] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:23 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:24.806427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:24.807040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:24.813944 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:24.814387 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:24.815182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:24.815619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:24.873033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:24.881342 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d78cf272-83f4-4556-a77b-52639cbca565 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078768 Apr 07 17:46:24.881907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1066/1995] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:24 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:25.899293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:25.899834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:25.906201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:25.906630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:25.907398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:25.907840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:25.965656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:25.973392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-42055ca1-3e12-48d2-93b3-8dab626bd5d1 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078003 Apr 07 17:46:25.973949 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 930/1996] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:25 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:26.990172 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:26.990814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:26.997099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:26.997584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:26.998345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:26.998781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:27.059716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:27.067542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3b46f942-93a7-4a21-8930-0def3e727071 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081281 Apr 07 17:46:27.068110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1067/1997] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:26 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:28.085276 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:28.085929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:28.092123 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:28.092572 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:28.093360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:28.094338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:28.155890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:28.163808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e5a64091-f395-4835-8ccb-247d2f3fbf2f tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.082459 Apr 07 17:46:28.164376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 931/1998] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:28 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:29.181494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:29.182100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:29.188447 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:29.188897 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:29.189686 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:29.190124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:29.249452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:29.257117 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a7965a1a-64e2-4f30-b2c8-2dba3ed279b4 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.079584 Apr 07 17:46:29.257710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1068/1999] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:29 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:30.274854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:30.275467 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:30.282673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:30.283118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:30.283879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:30.284308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:30.345161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:30.352760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3118e38a-c0d6-49da-9b81-b3c76e1cdd5e tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081810 Apr 07 17:46:30.353342 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 932/2000] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:30 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:30.779494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:46:30.779700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:46:31.370543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:31.371212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:31.377769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:31.378223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:31.378978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:31.379415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:31.440500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:31.448436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c08d882a-d0a1-4a1a-9a24-51ae4971a3ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081910 Apr 07 17:46:31.449002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1069/2001] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:31 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:32.465318 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:32.465952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:32.472330 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:32.472780 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:32.473580 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:32.474018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:32.689491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:32.697128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eba0ec82-22c8-48e8-a420-3e9c02183825 tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.235677 Apr 07 17:46:32.697706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 933/2002] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:32 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:33.714298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:33.714983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:33.722519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:33.722980 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:33.723760 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:33.724226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:33.787601 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:33.795521 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bfcb3190-a197-4882-9098-661b2473847d tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.085167 Apr 07 17:46:33.796033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1070/2003] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:33 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:46:34.814195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:34.814735 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:34.820579 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:34.821025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:34.821816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:34.822252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:34.882891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:34.891258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-23ee458f-0c2a-4fc4-9c2d-fb789be2d9ce tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.081264 Apr 07 17:46:34.891814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 934/2004] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:34 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:35.908226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:35.908765 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:35.915039 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:35.915483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:35.916239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:35.916671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:35.975091 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:35.982781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b7a756f0-d4e5-4610-8ebe-18dca63fdcde tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.078918 Apr 07 17:46:35.983340 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1071/2005] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:35 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:36.917846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:36.918367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:36.925686 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:36.926141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:36.926911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:36.927351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:36.940267 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] HTTP exception thrown: Instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 could not be found. Apr 07 17:46:36.940888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Returning 404 to user: Instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:46:36.941767 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1034f738-21db-4ed4-a2e7-fcd882882078 tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 404 len: 111 microversion: 2.1 time: 0.027688 Apr 07 17:46:36.951654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 935/2006] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:46:36 2022] DELETE /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:46:36.951763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:36.951763 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] [instance: c48aed11-0395-43fe-8a15-18ec4fc83ae2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:36.957229 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:36.957690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:36.958463 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:36.958908 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:36.972963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] HTTP exception thrown: Instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 could not be found. Apr 07 17:46:36.973585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] Returning 404 to user: Instance c48aed11-0395-43fe-8a15-18ec4fc83ae2 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:46:36.974423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f8b9d81e-e1e6-4442-a43f-5ad2dd40cefe tempest-AttachVolumeTestJSON-1249988154 tempest-AttachVolumeTestJSON-1249988154-project] 10.222.0.26 "GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2" status: 404 len: 111 microversion: 2.1 time: 0.028168 Apr 07 17:46:36.974955 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1072/2007] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:36 2022] GET /compute/v2.1/servers/c48aed11-0395-43fe-8a15-18ec4fc83ae2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:46:36.996879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:36.997520 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:37.000705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:37.001361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] [instance: fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:37.003719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:37.004162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:37.004925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:37.005496 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:37.007256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:37.007790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:37.008460 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:37.008898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:37.018972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] HTTP exception thrown: Instance bff11525-d802-480e-8301-be7c4bc7746f could not be found. Apr 07 17:46:37.021583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Returning 404 to user: Instance bff11525-d802-480e-8301-be7c4bc7746f could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:46:37.022800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-11a13755-6faa-423a-acc2-bb69a8c54167 tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 404 len: 111 microversion: 2.20 time: 0.029894 Apr 07 17:46:37.026236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 936/2008] 10.222.0.26 () {60 vars in 1279 bytes} [Thu Apr 7 17:46:36 2022] DELETE /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:46:37.031854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:37.032728 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] [instance: bff11525-d802-480e-8301-be7c4bc7746f] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:37.038992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:37.039445 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:37.040210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:37.040646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:37.057486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] HTTP exception thrown: Instance bff11525-d802-480e-8301-be7c4bc7746f could not be found. Apr 07 17:46:37.057992 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] Returning 404 to user: Instance bff11525-d802-480e-8301-be7c4bc7746f could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:46:37.058818 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-25ad3e6f-60e0-4823-bd40-5fb08f2e254f tempest-AttachVolumeShelveTestJSON-1452632862 tempest-AttachVolumeShelveTestJSON-1452632862-project] 10.222.0.26 "GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f" status: 404 len: 111 microversion: 2.20 time: 0.031483 Apr 07 17:46:37.059671 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 937/2009] 10.222.0.26 () {60 vars in 1276 bytes} [Thu Apr 7 17:46:37 2022] GET /compute/v2.1/servers/bff11525-d802-480e-8301-be7c4bc7746f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 07 17:46:37.080180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e941f28846a4bd8ab78dfbdaf7115e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81110c4ea45c46a88291fe2527aabd46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:37.085453 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-968cd474-179a-42af-8be4-08275099958c tempest-VolumesSnapshotTestJSON-306454966 tempest-VolumesSnapshotTestJSON-306454966-project] 10.222.0.26 "GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3" status: 200 len: 1350 microversion: 2.1 time: 0.089717 Apr 07 17:46:37.086017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1073/2010] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:36 2022] GET /compute/v2.1/servers/fd0e58cc-3ee1-4adf-8a64-3dc1a1bbc8d3 => generated 1350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:46:50.342340 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a0e10e67-e27e-48ef-b98a-7cb184387011 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: .version_select at 0x7ff9d53c6790>, body: {"keypair": {"name": "tempest-keypair-39118067"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:46:50.356934 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-a0e10e67-e27e-48ef-b98a-7cb184387011 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:46:50.361624 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-a0e10e67-e27e-48ef-b98a-7cb184387011 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:46:50.730632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-a0e10e67-e27e-48ef-b98a-7cb184387011 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:46:50.734563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-a0e10e67-e27e-48ef-b98a-7cb184387011 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:46:50.747359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a0e10e67-e27e-48ef-b98a-7cb184387011 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.526812 Apr 07 17:46:50.747960 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 938/2011] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:46:50 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:53.224583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1380238799", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58c1b1c1-2571-4626-8cc0-8332d9fac8a8"}], "security_groups": [{"name": "tempest-securitygroup--607110861"}], "key_name": "tempest-keypair-39118067", "user_data": "}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:46:53.338594 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] validate_networks() for [('58c1b1c1-2571-4626-8cc0-8332d9fac8a8', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:46:53.970015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:46:53.970707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:46:53.971419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:46:53.971916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:46:53.972331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:46:53.984071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:53.984795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:53.985818 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:53.986457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:54.004584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:46:54.008821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:46:54.021422 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:46:54.023820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:46:54.124107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-554b3322-3d63-4ee0-9cb1-05b5f4993b58 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.902880 Apr 07 17:46:54.124846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1074/2012] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:46:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:46:54.137186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-14290ba4-9190-4a84-b7b9-cb02c92a63b3 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:54.137186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-14290ba4-9190-4a84-b7b9-cb02c92a63b3 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:54.209651 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-14290ba4-9190-4a84-b7b9-cb02c92a63b3 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:54.216208 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-14290ba4-9190-4a84-b7b9-cb02c92a63b3 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1240 microversion: 2.1 time: 0.084948 Apr 07 17:46:54.217240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 939/2013] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:54 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:55.234782 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4581f4d0-7725-4ef7-a5be-edacae60846f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:55.236312 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4581f4d0-7725-4ef7-a5be-edacae60846f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:55.289458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4581f4d0-7725-4ef7-a5be-edacae60846f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:55.296610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4581f4d0-7725-4ef7-a5be-edacae60846f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1240 microversion: 2.1 time: 0.066830 Apr 07 17:46:55.297191 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1075/2014] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:55 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:56.314200 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:56.314800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:56.321832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:56.322281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:56.323094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:56.323742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:56.433680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:56.443794 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-933b7f50-6c97-499a-9456-2c29afc72219 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1300 microversion: 2.1 time: 0.133688 Apr 07 17:46:56.444734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 940/2015] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:56 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1300 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:57.468821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:57.469625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:57.476286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:57.476939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:57.478098 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:57.478632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:57.716402 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:57.725024 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ee81b437-a404-45c7-a37d-ebc25a5228a5 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1365 microversion: 2.1 time: 0.260973 Apr 07 17:46:57.725703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1076/2016] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:57 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:58.184989 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-dd0b81ba-ed34-4d5e-89a4-901b1f3ce34c req-1d78c53a-f9fa-4ff9-9483-f565cda5c81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48b4307-c086-46c4-8f80-a445cf7c63a9", "tag": "154484ae-2779-4ea1-9792-55da0c71faa4"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:46:58.202181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-dd0b81ba-ed34-4d5e-89a4-901b1f3ce34c req-1d78c53a-f9fa-4ff9-9483-f565cda5c81d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:58.202181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-dd0b81ba-ed34-4d5e-89a4-901b1f3ce34c req-1d78c53a-f9fa-4ff9-9483-f565cda5c81d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:58.214693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-dd0b81ba-ed34-4d5e-89a4-901b1f3ce34c req-1d78c53a-f9fa-4ff9-9483-f565cda5c81d service nova] Creating event network-changed:154484ae-2779-4ea1-9792-55da0c71faa4 for instance c48b4307-c086-46c4-8f80-a445cf7c63a9 on hv-cinder-83699 Apr 07 17:46:58.222109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-dd0b81ba-ed34-4d5e-89a4-901b1f3ce34c req-1d78c53a-f9fa-4ff9-9483-f565cda5c81d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040888 Apr 07 17:46:58.222800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 941/2017] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:46:58.742094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:58.742705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:58.749114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:58.749661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:58.750452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:58.750906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:58.957078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:46:58.964379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-805e0bfd-4628-413b-9f03-8947307e7fe9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1365 microversion: 2.1 time: 0.226044 Apr 07 17:46:58.965132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1077/2018] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:58 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:46:59.983410 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:46:59.984171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:46:59.990287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:59.990740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:46:59.991500 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:46:59.991942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:00.289609 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:47:00.297801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ef523f76-1b52-401a-ad7c-87c9c31c51fa tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1365 microversion: 2.1 time: 0.319525 Apr 07 17:47:00.298449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 942/2019] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:46:59 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1365 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:47:01.315200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:47:01.315832 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:47:01.322226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:01.322667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:01.323575 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:01.324011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:01.467005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:47:01.476556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8636849d-d482-4685-9bcb-658c27ffa7af tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1365 microversion: 2.1 time: 0.165755 Apr 07 17:47:01.481175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1078/2020] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:47:01 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:47:02.494052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:47:02.494663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:47:02.501558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:02.504293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:02.504293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:02.504293 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:02.641774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:47:02.648850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-feb417fb-1c45-4e5a-9d00-0a4b434eb5e9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1365 microversion: 2.1 time: 0.158653 Apr 07 17:47:02.649640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 943/2021] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:47:02 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:47:03.200454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-1077911e-56ad-4534-af8a-60eaf1b313a0 req-b3bf0135-8e42-465b-9057-042e551cdb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b4307-c086-46c4-8f80-a445cf7c63a9", "name": "network-vif-plugged", "status": "completed", "tag": "154484ae-2779-4ea1-9792-55da0c71faa4"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:47:03.210005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-1077911e-56ad-4534-af8a-60eaf1b313a0 req-b3bf0135-8e42-465b-9057-042e551cdb9e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:03.210453 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-1077911e-56ad-4534-af8a-60eaf1b313a0 req-b3bf0135-8e42-465b-9057-042e551cdb9e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:03.222057 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-1077911e-56ad-4534-af8a-60eaf1b313a0 req-b3bf0135-8e42-465b-9057-042e551cdb9e service nova] Creating event network-vif-plugged:154484ae-2779-4ea1-9792-55da0c71faa4 for instance c48b4307-c086-46c4-8f80-a445cf7c63a9 on hv-cinder-83699 Apr 07 17:47:03.227337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-1077911e-56ad-4534-af8a-60eaf1b313a0 req-b3bf0135-8e42-465b-9057-042e551cdb9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148164 Apr 07 17:47:03.228000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1079/2022] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:47:03.666674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:47:03.667275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:47:03.674608 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:03.675164 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:03.676288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:03.680046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:03.812010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:47:03.819194 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9e4a90f7-a9c5-4f78-b73b-d54d9d0adb9d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1365 microversion: 2.1 time: 0.156515 Apr 07 17:47:03.819754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 944/2023] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:47:03 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:47:04.837176 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:47:04.837874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:47:04.844239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:04.844690 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:04.845481 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:04.846011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:04.976232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:47:04.984171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e0679d47-2e44-4eb5-bcc6-413648ac3139 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1365 microversion: 2.1 time: 0.151738 Apr 07 17:47:04.984733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1080/2024] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:47:04 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:47:06.001667 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:47:06.002274 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:47:06.008131 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:06.008578 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:06.009366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:06.009801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:06.138268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:47:06.146629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2905b46c-7d79-430a-99d2-731c6ed675df tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1555 microversion: 2.1 time: 0.149642 Apr 07 17:47:06.147185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 945/2025] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:47:05 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:47:06.163070 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5a73131b-6934-418b-a342-70c866a82198 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:47:06.163625 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5a73131b-6934-418b-a342-70c866a82198 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:47:06.170048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a73131b-6934-418b-a342-70c866a82198 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:06.170878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a73131b-6934-418b-a342-70c866a82198 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:06.171845 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a73131b-6934-418b-a342-70c866a82198 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:06.172449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5a73131b-6934-418b-a342-70c866a82198 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:06.256349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5a73131b-6934-418b-a342-70c866a82198 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097082 Apr 07 17:47:06.256941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1081/2026] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Apr 7 17:47:06 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:47:07.477944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-28ae2a02-8fbf-4914-bce8-76ad6477763e req-523f8298-5f5b-4d00-9c36-661049ee0b4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48b4307-c086-46c4-8f80-a445cf7c63a9", "tag": "154484ae-2779-4ea1-9792-55da0c71faa4"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:47:07.486488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-28ae2a02-8fbf-4914-bce8-76ad6477763e req-523f8298-5f5b-4d00-9c36-661049ee0b4e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:07.486921 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-28ae2a02-8fbf-4914-bce8-76ad6477763e req-523f8298-5f5b-4d00-9c36-661049ee0b4e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:07.497560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-28ae2a02-8fbf-4914-bce8-76ad6477763e req-523f8298-5f5b-4d00-9c36-661049ee0b4e service nova] Creating event network-changed:154484ae-2779-4ea1-9792-55da0c71faa4 for instance c48b4307-c086-46c4-8f80-a445cf7c63a9 on hv-cinder-83699 Apr 07 17:47:07.502636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-28ae2a02-8fbf-4914-bce8-76ad6477763e req-523f8298-5f5b-4d00-9c36-661049ee0b4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028278 Apr 07 17:47:07.503226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 946/2027] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:47:41.760126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6b782a93-353e-4a93-999b-59fcdaf7acd9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:47:41.760975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6b782a93-353e-4a93-999b-59fcdaf7acd9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:47:41.769168 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6b782a93-353e-4a93-999b-59fcdaf7acd9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:41.769605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6b782a93-353e-4a93-999b-59fcdaf7acd9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:41.770371 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6b782a93-353e-4a93-999b-59fcdaf7acd9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:47:41.770795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6b782a93-353e-4a93-999b-59fcdaf7acd9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:47:41.792597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6b782a93-353e-4a93-999b-59fcdaf7acd9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9/ips" status: 200 len: 150 microversion: 2.1 time: 0.036948 Apr 07 17:47:41.793344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1082/2028] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:47:41 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:48:18.620759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:48:18.621610 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:48:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:49:29.338558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:49:29.339056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:49:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:49:33.886508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:49:33.887314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:49:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:49:50.788320 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:49:50.788861 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:49:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:50:06.665129 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:50:06.665576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:50:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:50:12.724158 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:50:12.724667 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:51:38.630199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:51:38.630712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:51:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:52:49.346563 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:52:49.347116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:52:53.895281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:52:53.895843 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:52:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:53:10.796435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:53:10.796998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:53:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:53:26.673902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:53:26.674478 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 17:53:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:53:32.733017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:53:32.733582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:53:42.931777 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde73ec9-a780-4a37-89c1-39d7332abdc0] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 17:53:42.935894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:42.936469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:42.942589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:42.943033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:42.943792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:42.944226 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:42.968210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:53:43.212057 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cb0ead1b-4431-492d-9d3f-8c27dcbe5cae tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 204 len: 0 microversion: 2.1 time: 0.282258 Apr 07 17:53:43.212629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 947/2029] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:53:42 2022] DELETE /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:53:43.220814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: ERROR oslo.messaging._drivers.impl_rabbit [-] [443f9cd2-24ee-4c66-bfc7-444c68cf96aa] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 07 17:53:43.224383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:43.225021 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:43.231134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:43.231586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:43.232354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:43.232805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:43.458365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:43.466759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-37e1d86b-78d5-4195-bc8d-53ef8430fdff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1680 microversion: 2.1 time: 0.247969 Apr 07 17:53:43.467265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1083/2030] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:43 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1680 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:44.485185 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:44.485888 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:44.493659 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:44.494109 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:44.495060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:44.495494 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:44.500839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde73ec9-a780-4a37-89c1-39d7332abdc0] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37302. Apr 07 17:53:44.696092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:44.705069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5847669d-62c4-46cf-bd08-40a4725dfd98 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 200 len: 1613 microversion: 2.1 time: 0.224120 Apr 07 17:53:44.705693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 948/2031] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:44 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 1613 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:44.827488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] [443f9cd2-24ee-4c66-bfc7-444c68cf96aa] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 37314. Apr 07 17:53:44.876393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-3ed4848e-afb6-464e-b51d-1587c20a59ab req-f7a00c02-addf-426a-9b0b-fde7766454cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b4307-c086-46c4-8f80-a445cf7c63a9", "name": "network-vif-deleted", "tag": "154484ae-2779-4ea1-9792-55da0c71faa4"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:53:44.884675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-3ed4848e-afb6-464e-b51d-1587c20a59ab req-f7a00c02-addf-426a-9b0b-fde7766454cc service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:44.885163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-3ed4848e-afb6-464e-b51d-1587c20a59ab req-f7a00c02-addf-426a-9b0b-fde7766454cc service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:44.898163 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-3ed4848e-afb6-464e-b51d-1587c20a59ab req-f7a00c02-addf-426a-9b0b-fde7766454cc service nova] Creating event network-vif-deleted:154484ae-2779-4ea1-9792-55da0c71faa4 for instance c48b4307-c086-46c4-8f80-a445cf7c63a9 on hv-cinder-83699 Apr 07 17:53:44.905704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-3ed4848e-afb6-464e-b51d-1587c20a59ab req-f7a00c02-addf-426a-9b0b-fde7766454cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090674 Apr 07 17:53:44.906664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1084/2032] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:53:45.723034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:45.723649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:45.730301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:45.730746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:45.731584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:45.732024 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:45.747513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance c48b4307-c086-46c4-8f80-a445cf7c63a9 could not be found. Apr 07 17:53:45.748714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance c48b4307-c086-46c4-8f80-a445cf7c63a9 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:53:45.748996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c2aca57d-513a-491e-ac47-fed98af75cfb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 404 len: 111 microversion: 2.1 time: 0.029818 Apr 07 17:53:45.749759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 949/2033] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:45 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:53:45.758330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9ffeed3a-fab9-4440-91b3-d36d2ce33959 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '.version_select at 0x7ff9d031f160>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:45.876880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9ffeed3a-fab9-4440-91b3-d36d2ce33959 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-39118067" status: 202 len: 0 microversion: 2.1 time: 0.122573 Apr 07 17:53:45.883469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1085/2034] 10.222.0.26 () {58 vars in 1214 bytes} [Thu Apr 7 17:53:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-39118067 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:53:46.670247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c4906e35-f6dd-4a77-8ee8-5191f3a01381 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: .version_select at 0x7ff9d03ddd30>, body: {"keypair": {"name": "tempest-keypair-979528262"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:53:46.687532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c4906e35-f6dd-4a77-8ee8-5191f3a01381 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:53:46.688638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c4906e35-f6dd-4a77-8ee8-5191f3a01381 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:53:46.989374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c4906e35-f6dd-4a77-8ee8-5191f3a01381 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:53:46.993100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c4906e35-f6dd-4a77-8ee8-5191f3a01381 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:53:47.006602 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c4906e35-f6dd-4a77-8ee8-5191f3a01381 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.341352 Apr 07 17:53:47.007187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 950/2035] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:53:46 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:53:48.993919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-458423423", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58c1b1c1-2571-4626-8cc0-8332d9fac8a8"}], "security_groups": [{"name": "tempest-securitygroup--872137483"}], "key_name": "tempest-keypair-979528262", "user_data": "}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:53:49.097648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] validate_networks() for [('58c1b1c1-2571-4626-8cc0-8332d9fac8a8', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:53:49.508250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:53:49.508675 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:53:49.509167 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:53:49.509593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:53:49.510037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:53:49.519424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:49.519900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:49.520694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:49.521130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:49.537224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:53:49.541215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:53:49.551898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:53:49.554375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:53:49.672597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bd83b6fd-4d40-41b9-ab77-1710150df630 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.683004 Apr 07 17:53:49.673526 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1086/2036] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:53:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:53:49.689117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0350f216-854c-4c4e-9ef7-5bca7c3335d6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:49.690236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0350f216-854c-4c4e-9ef7-5bca7c3335d6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:49.743925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0350f216-854c-4c4e-9ef7-5bca7c3335d6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:49.751702 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0350f216-854c-4c4e-9ef7-5bca7c3335d6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1240 microversion: 2.1 time: 0.071728 Apr 07 17:53:49.752468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 951/2037] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:49 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:50.770649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:50.771255 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:50.778820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:50.779263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:50.780018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:50.780451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:50.838493 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:50.846029 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2b0a52ea-5306-4c0d-922d-135fa030deda tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1236 microversion: 2.1 time: 0.079406 Apr 07 17:53:50.846604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1087/2038] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:50 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:51.863916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:51.864565 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:51.871321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:51.871814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:51.872723 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:51.873203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:51.939497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:51.947396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a4480d57-b578-4405-8988-2767ce5942db tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1298 microversion: 2.1 time: 0.087186 Apr 07 17:53:51.957594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 952/2039] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:51 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:52.964696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:52.965368 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:52.971475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:52.972147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:52.973100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:52.973717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:52.989934 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-641108eb-a96b-4980-bd7c-8dc8073412a1 req-859ef8b0-3c63-4b47-abba-2ae2fb50a190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ede5e5-772c-41d3-ae1c-2c65c0ef75cd", "tag": "328f791a-41c2-46f0-a858-f451ca0f6a50"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:53:53.003688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-641108eb-a96b-4980-bd7c-8dc8073412a1 req-859ef8b0-3c63-4b47-abba-2ae2fb50a190 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:53.004589 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-641108eb-a96b-4980-bd7c-8dc8073412a1 req-859ef8b0-3c63-4b47-abba-2ae2fb50a190 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:53.031403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-641108eb-a96b-4980-bd7c-8dc8073412a1 req-859ef8b0-3c63-4b47-abba-2ae2fb50a190 service nova] Creating event network-changed:328f791a-41c2-46f0-a858-f451ca0f6a50 for instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd on hv-cinder-83699 Apr 07 17:53:53.037367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-641108eb-a96b-4980-bd7c-8dc8073412a1 req-859ef8b0-3c63-4b47-abba-2ae2fb50a190 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051827 Apr 07 17:53:53.038582 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 953/2040] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:53:53.237800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:53.246450 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1ece4882-5475-4421-bb44-ae8f4672f505 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1365 microversion: 2.1 time: 0.285339 Apr 07 17:53:53.247063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1088/2041] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:52 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:54.264947 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:54.265674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:54.271856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:54.272308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:54.273074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:54.273584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:54.410089 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:54.417848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-523ee037-5d58-4b44-86f1-fdbcdb2ed64d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1365 microversion: 2.1 time: 0.158450 Apr 07 17:53:54.418402 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 954/2042] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:54 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:55.435187 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:55.435798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:55.444890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:55.445484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:55.446520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:55.446952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:55.587282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:55.594860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-019a2fd1-ce10-442c-92cd-ed93fd388df0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1365 microversion: 2.1 time: 0.164248 Apr 07 17:53:55.595425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1089/2043] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:55 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:56.611780 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:56.612396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:56.618654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:56.619100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:56.620081 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:56.620573 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:56.773280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:56.781157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b0d14d26-ada5-4157-aaf7-173f825242f0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1365 microversion: 2.1 time: 0.173186 Apr 07 17:53:56.781736 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 955/2044] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:56 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:57.798222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:57.798840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:57.805192 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:57.805652 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:57.806415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:57.806859 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:57.938123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:57.945277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9a4151c5-ff18-4fae-b944-c5877a6d19f9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1365 microversion: 2.1 time: 0.150947 Apr 07 17:53:57.945842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1090/2045] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:57 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:58.961984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:53:58.962620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:53:58.969495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:58.969944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:58.970727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:58.971165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:59.110910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:53:59.112672 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-36989663-68eb-448e-9924-82cd7380b31b req-6175bf87-694b-4a8b-8f1f-ef8fce9fecc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ede5e5-772c-41d3-ae1c-2c65c0ef75cd", "name": "network-vif-plugged", "status": "completed", "tag": "328f791a-41c2-46f0-a858-f451ca0f6a50"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:53:59.119169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1928f654-dd41-4cd9-afd9-9f4a5aba09bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1365 microversion: 2.1 time: 0.160922 Apr 07 17:53:59.121076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 956/2046] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:53:58 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:53:59.122936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-36989663-68eb-448e-9924-82cd7380b31b req-6175bf87-694b-4a8b-8f1f-ef8fce9fecc4 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:53:59.123451 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-36989663-68eb-448e-9924-82cd7380b31b req-6175bf87-694b-4a8b-8f1f-ef8fce9fecc4 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:53:59.134762 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-36989663-68eb-448e-9924-82cd7380b31b req-6175bf87-694b-4a8b-8f1f-ef8fce9fecc4 service nova] Creating event network-vif-plugged:328f791a-41c2-46f0-a858-f451ca0f6a50 for instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd on hv-cinder-83699 Apr 07 17:53:59.140595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-36989663-68eb-448e-9924-82cd7380b31b req-6175bf87-694b-4a8b-8f1f-ef8fce9fecc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083778 Apr 07 17:53:59.141225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1091/2047] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:54:00.136875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:00.137458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:00.144043 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:00.144487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:00.145586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:00.146033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:00.282084 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:54:00.289221 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-339430da-308a-4f67-9aa1-1569dfeb9636 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1365 microversion: 2.1 time: 0.156300 Apr 07 17:54:00.289804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 957/2048] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:00 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:54:01.308577 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:01.309287 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:01.315414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:01.315862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:01.316605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:01.317044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:01.452849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:54:01.463274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f415f5c8-3268-4eb4-bbe4-240a06b5e690 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1556 microversion: 2.1 time: 0.160067 Apr 07 17:54:01.464425 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1092/2049] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:01 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:54:01.480577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-162cf860-d9f4-4c6e-befe-186964c3cb8d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:01.481085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-162cf860-d9f4-4c6e-befe-186964c3cb8d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:01.487399 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-162cf860-d9f4-4c6e-befe-186964c3cb8d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:01.487846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-162cf860-d9f4-4c6e-befe-186964c3cb8d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:01.488606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-162cf860-d9f4-4c6e-befe-186964c3cb8d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:01.489040 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-162cf860-d9f4-4c6e-befe-186964c3cb8d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:01.568908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-162cf860-d9f4-4c6e-befe-186964c3cb8d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092833 Apr 07 17:54:01.569615 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 958/2050] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Apr 7 17:54:01 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:02.810735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-931b69b8-507b-44b4-b883-8e8ee0339ef9 req-906862bd-89f1-4571-981c-b17ce0aa1558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46ede5e5-772c-41d3-ae1c-2c65c0ef75cd", "tag": "328f791a-41c2-46f0-a858-f451ca0f6a50"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:54:02.819088 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-931b69b8-507b-44b4-b883-8e8ee0339ef9 req-906862bd-89f1-4571-981c-b17ce0aa1558 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:02.819534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-931b69b8-507b-44b4-b883-8e8ee0339ef9 req-906862bd-89f1-4571-981c-b17ce0aa1558 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:02.831419 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-931b69b8-507b-44b4-b883-8e8ee0339ef9 req-906862bd-89f1-4571-981c-b17ce0aa1558 service nova] Creating event network-changed:328f791a-41c2-46f0-a858-f451ca0f6a50 for instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd on hv-cinder-83699 Apr 07 17:54:02.836621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-931b69b8-507b-44b4-b883-8e8ee0339ef9 req-906862bd-89f1-4571-981c-b17ce0aa1558 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029483 Apr 07 17:54:02.837415 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1093/2051] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:36.196060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:36.196606 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:36.202481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:36.202924 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:36.204216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:36.204673 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:36.228736 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:54:36.488099 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-35007b7d-bb71-4759-9003-fd5184e30561 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 204 len: 0 microversion: 2.1 time: 0.295945 Apr 07 17:54:36.488599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 959/2052] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:54:36 2022] DELETE /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:54:36.497651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:36.498348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:36.504717 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:36.505203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:36.505969 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:36.506406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:36.648834 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:54:36.656710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2a88921b-d0c8-4163-85f3-6a3570626536 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1508 microversion: 2.1 time: 0.163601 Apr 07 17:54:36.657607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1094/2053] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:36 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:54:36.672487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9ed7551f-a1c1-4a18-8c27-e1ccd4bf5785 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:36.673920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9ed7551f-a1c1-4a18-8c27-e1ccd4bf5785 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:36.681782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9ed7551f-a1c1-4a18-8c27-e1ccd4bf5785 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:36.683579 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9ed7551f-a1c1-4a18-8c27-e1ccd4bf5785 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:36.683579 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9ed7551f-a1c1-4a18-8c27-e1ccd4bf5785 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:36.683579 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9ed7551f-a1c1-4a18-8c27-e1ccd4bf5785 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:36.707402 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9ed7551f-a1c1-4a18-8c27-e1ccd4bf5785 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/ips" status: 200 len: 149 microversion: 2.1 time: 0.039087 Apr 07 17:54:36.708260 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 960/2054] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:54:36 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:37.572208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-c3eebbb4-6300-4102-b0b7-14407e2f87e4 req-c8ebb7de-9ad3-47f7-871f-5098533b55aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f29ee7a-7774-4b2a-a97b-d418a22fd251", "name": "network-vif-deleted", "tag": "9a780e11-fd18-4861-8227-6aae03c308ca"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:54:37.581632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-c3eebbb4-6300-4102-b0b7-14407e2f87e4 req-c8ebb7de-9ad3-47f7-871f-5098533b55aa service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:37.583548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-c3eebbb4-6300-4102-b0b7-14407e2f87e4 req-c8ebb7de-9ad3-47f7-871f-5098533b55aa service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:37.593333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-c3eebbb4-6300-4102-b0b7-14407e2f87e4 req-c8ebb7de-9ad3-47f7-871f-5098533b55aa service nova] Creating event network-vif-deleted:9a780e11-fd18-4861-8227-6aae03c308ca for instance 7f29ee7a-7774-4b2a-a97b-d418a22fd251 on hv-cinder-83699 Apr 07 17:54:37.600430 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-c3eebbb4-6300-4102-b0b7-14407e2f87e4 req-c8ebb7de-9ad3-47f7-871f-5098533b55aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031478 Apr 07 17:54:37.601664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1095/2055] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:54:37.674234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:37.675096 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:37.681483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:37.681965 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:37.682733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:37.683171 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:37.746258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:54:37.753842 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c46bc286-e473-453c-80d9-b4ffc914cbbc tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 200 len: 1466 microversion: 2.1 time: 0.083536 Apr 07 17:54:37.754401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 961/2056] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:37 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 1466 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:54:38.772703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:38.773426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 7f29ee7a-7774-4b2a-a97b-d418a22fd251] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:38.779541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:38.779988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:38.780745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:38.781204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:38.794768 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] HTTP exception thrown: Instance 7f29ee7a-7774-4b2a-a97b-d418a22fd251 could not be found. Apr 07 17:54:38.795354 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Returning 404 to user: Instance 7f29ee7a-7774-4b2a-a97b-d418a22fd251 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:54:38.796173 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e86a1e38-baa0-49b3-8886-0697c651650b tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251" status: 404 len: 111 microversion: 2.1 time: 0.028236 Apr 07 17:54:38.796720 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1096/2057] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:38 2022] GET /compute/v2.1/servers/7f29ee7a-7774-4b2a-a97b-d418a22fd251 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:54:38.805531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:38.806075 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:38.812313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:38.812766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:38.813778 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:38.814222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:38.837428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:54:39.099904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ee82b2c9-2335-4592-9be6-13b40a8a6ebd tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 204 len: 0 microversion: 2.1 time: 0.297947 Apr 07 17:54:39.100491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 962/2058] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:54:38 2022] DELETE /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:54:39.108397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:39.109472 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:39.115676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:39.116139 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:39.116906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:39.117383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:39.255448 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:54:39.262940 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bfc224b8-911b-47bb-9324-818e7d432a14 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1522 microversion: 2.1 time: 0.158407 Apr 07 17:54:39.263495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1097/2059] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:39 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:54:40.090910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-d39ba2df-6c69-42b4-8657-2afd9e85c396 req-e955c0e1-30ce-49e7-8c40-607d68e79e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6861b8a6-c175-4196-998d-c63ddc75145a", "name": "network-vif-deleted", "tag": "36b21861-dbf8-4125-9ae9-842aaed8add5"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:54:40.099178 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-d39ba2df-6c69-42b4-8657-2afd9e85c396 req-e955c0e1-30ce-49e7-8c40-607d68e79e8e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:40.099620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-d39ba2df-6c69-42b4-8657-2afd9e85c396 req-e955c0e1-30ce-49e7-8c40-607d68e79e8e service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:40.110802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-d39ba2df-6c69-42b4-8657-2afd9e85c396 req-e955c0e1-30ce-49e7-8c40-607d68e79e8e service nova] Creating event network-vif-deleted:36b21861-dbf8-4125-9ae9-842aaed8add5 for instance 6861b8a6-c175-4196-998d-c63ddc75145a on hv-cinder-83699 Apr 07 17:54:40.115564 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-d39ba2df-6c69-42b4-8657-2afd9e85c396 req-e955c0e1-30ce-49e7-8c40-607d68e79e8e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028667 Apr 07 17:54:40.116137 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 963/2060] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:40.279795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:40.280488 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:40.287673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:40.288201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:40.288973 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:40.289432 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:40.321249 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:40.321632 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:40.322089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lazy-loading 'fault' on Instance uuid 6861b8a6-c175-4196-998d-c63ddc75145a {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:54:40.362737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9717b85343d14a1c919091f29a591763', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03828970d20c4ed09fa9c9ec412782ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:54:40.371154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5830415f-2897-438d-ac42-768a630610a6 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 200 len: 1311 microversion: 2.1 time: 0.094999 Apr 07 17:54:40.371599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1098/2061] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:40 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:54:41.393899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:41.394588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] [instance: 6861b8a6-c175-4196-998d-c63ddc75145a] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:54:41.400576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:41.401018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:41.401796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:54:41.402227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:54:41.417287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] HTTP exception thrown: Instance 6861b8a6-c175-4196-998d-c63ddc75145a could not be found. Apr 07 17:54:41.417867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] Returning 404 to user: Instance 6861b8a6-c175-4196-998d-c63ddc75145a could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:54:41.418675 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e626a194-e8aa-46c1-abc3-fad17cfc6221 tempest-ServerRescueNegativeTestJSON-958174661 tempest-ServerRescueNegativeTestJSON-958174661-project] 10.222.0.26 "GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a" status: 404 len: 111 microversion: 2.1 time: 0.030780 Apr 07 17:54:41.419201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 964/2062] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:54:41 2022] GET /compute/v2.1/servers/6861b8a6-c175-4196-998d-c63ddc75145a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:54:46.977959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6ec7f530-fd64-466e-ae00-a9543cecc5ba tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Action: 'create', calling method: .version_select at 0x7ff9d0308f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1987307156"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:54:47.595444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6ec7f530-fd64-466e-ae00-a9543cecc5ba tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.722078 Apr 07 17:54:47.595444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1099/2063] 10.222.0.26 () {60 vars in 1154 bytes} [Thu Apr 7 17:54:46 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 723 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 07 17:54:47.604263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-20bc0b4e-9524-441e-9caa-717754757a50 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0545700>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:47.659745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-20bc0b4e-9524-441e-9caa-717754757a50 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.059478 Apr 07 17:54:47.660319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 965/2064] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:47 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:48.671934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a42c4591-17ff-48a8-8131-a6af1fc78c1a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d02aaee0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:48.718651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a42c4591-17ff-48a8-8131-a6af1fc78c1a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050938 Apr 07 17:54:48.719231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1100/2065] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:48 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:49.732191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-73321fee-c1c5-45b2-a6ce-52f5203cff2c tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d543a160>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:49.777973 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-73321fee-c1c5-45b2-a6ce-52f5203cff2c tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050337 Apr 07 17:54:49.778534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 966/2066] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:49 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:50.790070 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-32fd6e63-3bd7-4bd9-94fc-4dc0f7da4054 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0305280>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:50.836434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-32fd6e63-3bd7-4bd9-94fc-4dc0f7da4054 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050003 Apr 07 17:54:50.837004 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1101/2067] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:50 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:51.850006 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5b6cec8a-a4f9-49ab-8214-14b7e25e3329 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d03ddc10>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:51.896329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5b6cec8a-a4f9-49ab-8214-14b7e25e3329 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050970 Apr 07 17:54:51.896890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 967/2068] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:51 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:52.908651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e8a9abf0-232c-4ec9-a76d-4b933158c7b2 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d04aa280>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:52.953492 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e8a9abf0-232c-4ec9-a76d-4b933158c7b2 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049616 Apr 07 17:54:52.954616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1102/2069] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:52 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:53.966530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d4c6ce92-33cd-4165-93ca-cbb28429ff87 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d05453a0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:54.011155 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d4c6ce92-33cd-4165-93ca-cbb28429ff87 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.048784 Apr 07 17:54:54.011716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 968/2070] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:53 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:55.024149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b250b3e9-037e-4d7a-b3f4-e0e3750cedc5 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0616940>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:55.070455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b250b3e9-037e-4d7a-b3f4-e0e3750cedc5 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050480 Apr 07 17:54:55.071014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1103/2071] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:55 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:56.083772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-bd016092-de0e-4789-a7c7-ffd8b99999e6 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d03dd4c0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:56.128742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-bd016092-de0e-4789-a7c7-ffd8b99999e6 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049878 Apr 07 17:54:56.129338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 969/2072] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:56 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:57.141401 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5977fc00-0c42-4fcc-9e60-94e04a75ac86 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0483a60>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:57.192099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5977fc00-0c42-4fcc-9e60-94e04a75ac86 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.051394 Apr 07 17:54:57.192099 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1104/2073] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:57 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:58.203085 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-81a9bc5f-b677-4aff-a819-5a08f78cf0c3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0442700>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:58.249612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-81a9bc5f-b677-4aff-a819-5a08f78cf0c3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050989 Apr 07 17:54:58.250173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 970/2074] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:58 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:54:59.263212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-948d4742-2111-4848-a7a5-bbc8a46bb623 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d04aa670>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:54:59.308706 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-948d4742-2111-4848-a7a5-bbc8a46bb623 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049680 Apr 07 17:54:59.309394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1105/2075] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:54:59 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:00.322654 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a56967c5-e459-4bcc-985f-07d7db1c9371 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d5474670>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:00.371338 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a56967c5-e459-4bcc-985f-07d7db1c9371 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.052986 Apr 07 17:55:00.376828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 971/2076] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:00 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:01.384106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-670dca7b-52bb-445a-ac54-002e943eaf34 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d03a23a0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:01.430665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-670dca7b-52bb-445a-ac54-002e943eaf34 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050778 Apr 07 17:55:01.431235 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1106/2077] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:01 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:02.443761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a0ae6609-3f13-4940-93f4-a3a9dd312f84 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53f33a0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:02.490446 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a0ae6609-3f13-4940-93f4-a3a9dd312f84 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.051114 Apr 07 17:55:02.491013 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 972/2078] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:02 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:03.503829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d3240902-ec40-4adf-a4ce-edbbf6bd9112 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0483e50>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:03.553315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d3240902-ec40-4adf-a4ce-edbbf6bd9112 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.054279 Apr 07 17:55:03.553967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1107/2079] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:03 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:04.566459 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b6ca0c88-f4ba-4e52-901b-85e2ecc70b9d tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d54991f0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:04.613740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b6ca0c88-f4ba-4e52-901b-85e2ecc70b9d tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.051635 Apr 07 17:55:04.614310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 973/2080] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:04 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:05.626624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-54cca85d-b737-4658-b5a5-025fb197fd7e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0483c10>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:05.674397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-54cca85d-b737-4658-b5a5-025fb197fd7e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.051951 Apr 07 17:55:05.677525 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1108/2081] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:05 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:06.686978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-27ba3714-8e34-46c1-85ef-692855638ecb tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0545820>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:06.733385 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-27ba3714-8e34-46c1-85ef-692855638ecb tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050450 Apr 07 17:55:06.733925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 974/2082] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:06 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:07.745691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b8badb95-4c63-48ec-8bba-556c00b674ec tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d54d0160>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:07.791372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b8badb95-4c63-48ec-8bba-556c00b674ec tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049925 Apr 07 17:55:07.791948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1109/2083] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:07 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:08.803881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f97e59de-ce4c-470b-bc93-804707003c45 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d5416820>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:08.849013 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f97e59de-ce4c-470b-bc93-804707003c45 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049241 Apr 07 17:55:08.849630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 975/2084] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:08 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:09.862190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-556f1515-8954-44b3-8034-21a1ab6b1810 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d03055e0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:09.907113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-556f1515-8954-44b3-8034-21a1ab6b1810 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049809 Apr 07 17:55:09.908578 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1110/2085] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:09 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:10.920011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-72d37ee2-7977-4c99-9443-0d501a92fda7 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d550a430>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:10.966758 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-72d37ee2-7977-4c99-9443-0d501a92fda7 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050925 Apr 07 17:55:10.967331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 976/2086] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:10 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:11.979576 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-36786a91-1435-4d95-9eb5-6dcfd4b6d121 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d04bf4c0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:12.024609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-36786a91-1435-4d95-9eb5-6dcfd4b6d121 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049256 Apr 07 17:55:12.025195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1111/2087] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:11 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:13.038029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a1771edb-e8df-4fe6-ab68-daafb7375288 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53d8c10>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:13.083132 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a1771edb-e8df-4fe6-ab68-daafb7375288 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049908 Apr 07 17:55:13.083694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 977/2088] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:13 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:14.095956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e15d8032-c3ba-49ab-a7ac-941535956525 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0483ee0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:14.140729 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e15d8032-c3ba-49ab-a7ac-941535956525 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049089 Apr 07 17:55:14.141378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1112/2089] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:14 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:15.153810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7e2c0209-ac06-4b66-9281-1073d9a65128 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53f3160>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:15.198877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7e2c0209-ac06-4b66-9281-1073d9a65128 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049316 Apr 07 17:55:15.199469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 978/2090] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:15 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:16.212111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3bd36a81-5344-48bf-9e67-acba78d6f20a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d02d1670>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:16.258617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3bd36a81-5344-48bf-9e67-acba78d6f20a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050780 Apr 07 17:55:16.259192 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1113/2091] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:16 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:55:17.272110 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-8215e8e9-d1e0-452a-b856-974ac1d3afe5 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53f31f0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:17.316763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-8215e8e9-d1e0-452a-b856-974ac1d3afe5 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049385 Apr 07 17:55:17.317343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 979/2092] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:17 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:18.329443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5d98ac53-4c9b-4f59-85ba-42626563fc57 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0483040>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:18.375346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5d98ac53-4c9b-4f59-85ba-42626563fc57 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050082 Apr 07 17:55:18.376009 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1114/2093] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:18 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:19.388821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-628f8d19-00cb-419d-847a-524a76afbd27 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53d8c10>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:19.435229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-628f8d19-00cb-419d-847a-524a76afbd27 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050617 Apr 07 17:55:19.435816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 980/2094] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:19 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:20.448267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0e16e512-82e3-4697-a8a2-f3ee47ab5210 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d54d04c0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:20.493983 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0e16e512-82e3-4697-a8a2-f3ee47ab5210 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049918 Apr 07 17:55:20.494549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1115/2095] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:20 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:21.507610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7f74edb1-e454-40f6-b527-97ce8c5bea8c tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d550ae50>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:21.553118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7f74edb1-e454-40f6-b527-97ce8c5bea8c tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050459 Apr 07 17:55:21.553699 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 981/2096] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:21 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:22.566532 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ba2b527c-7c07-4546-8f94-165b35be1c96 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d17c1790>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:22.611207 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ba2b527c-7c07-4546-8f94-165b35be1c96 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049652 Apr 07 17:55:22.611767 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1116/2097] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:22 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:23.624874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2199b1c1-0fe2-4fe6-9140-4b2c40be7780 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0e5d820>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:23.671056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2199b1c1-0fe2-4fe6-9140-4b2c40be7780 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050719 Apr 07 17:55:23.675441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 982/2098] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:23 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:24.684069 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-762ed362-e5c2-42fc-b168-55ef7898c90f tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d03a2310>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:24.729484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-762ed362-e5c2-42fc-b168-55ef7898c90f tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049535 Apr 07 17:55:24.730054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1117/2099] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:24 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:25.744291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4dafa389-312b-4566-9a1d-0041ad6b20a3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d54741f0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:25.793815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4dafa389-312b-4566-9a1d-0041ad6b20a3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.053885 Apr 07 17:55:25.794390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 983/2100] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:25 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:26.807095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d91af503-8139-43ec-a575-7d7f1ee206dd tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0483c10>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:26.852511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d91af503-8139-43ec-a575-7d7f1ee206dd tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049697 Apr 07 17:55:26.853097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1118/2101] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:26 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:27.865265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-24a0fc75-e466-44be-b6a5-bb942e575e3e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0545940>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:27.909642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-24a0fc75-e466-44be-b6a5-bb942e575e3e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.048734 Apr 07 17:55:27.910958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 984/2102] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:27 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:28.923184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c226c028-54e3-4117-a94e-69dea73f1b15 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d17bc790>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:28.969466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c226c028-54e3-4117-a94e-69dea73f1b15 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.050370 Apr 07 17:55:28.970027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1119/2103] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:28 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:29.983372 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-19ab2b0b-3697-4ec8-a278-7633a7112516 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0e9d310>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:30.028319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-19ab2b0b-3697-4ec8-a278-7633a7112516 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.049627 Apr 07 17:55:30.028879 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 985/2104] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:29 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:31.041320 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-40c08161-1b88-409e-a45a-78034ed42054 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d04834c0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:31.093954 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-40c08161-1b88-409e-a45a-78034ed42054 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.057802 Apr 07 17:55:31.097712 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1120/2105] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:31 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:32.107245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-19cc1494-04d0-486d-a06b-8b56f92fde04 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53d8a60>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:32.154489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-19cc1494-04d0-486d-a06b-8b56f92fde04 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 346 microversion: 2.1 time: 0.051494 Apr 07 17:55:32.155058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 986/2106] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:32 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:32.167787 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-355b5522-e7fd-4fc2-8116-721855fc5be0 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Action: 'create', calling method: .version_select at 0x7ff9d54d0160>, body: {"snapshot": {"volume_id": "3a22ed79-ff6c-4cd7-9c63-b14087e65cda", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-76556056"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:55:32.599481 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-355b5522-e7fd-4fc2-8116-721855fc5be0 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.436120 Apr 07 17:55:32.600062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1121/2107] 10.222.0.26 () {60 vars in 1161 bytes} [Thu Apr 7 17:55:32 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:32.610441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5fdc02a2-7cbd-4429-915f-ca62b5b3e1e9 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d5416af0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:32.640224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5fdc02a2-7cbd-4429-915f-ca62b5b3e1e9 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.034121 Apr 07 17:55:32.640998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 987/2108] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:32 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:32.651012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1209bfd6-dfbf-4367-be11-6bfeb6f1f52d tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0308ee0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:32.688180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1209bfd6-dfbf-4367-be11-6bfeb6f1f52d tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.040989 Apr 07 17:55:32.693945 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1122/2109] 10.222.0.26 () {58 vars in 1139 bytes} [Thu Apr 7 17:55:32 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:32.699528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6e4002ec-cd32-4963-8ca3-e0c991684292 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53c6940>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:32.731754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-67a54ece-9d66-4b52-8986-6f99c050bb0f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7c430f6-d1e5-472d-be37-b95cfaf72ccc"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:55:32.732649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-67a54ece-9d66-4b52-8986-6f99c050bb0f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:32.738782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6e4002ec-cd32-4963-8ca3-e0c991684292 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.043357 Apr 07 17:55:32.739929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 988/2110] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:32 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:32.741075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67a54ece-9d66-4b52-8986-6f99c050bb0f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:32.741574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67a54ece-9d66-4b52-8986-6f99c050bb0f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:32.742709 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67a54ece-9d66-4b52-8986-6f99c050bb0f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:32.743151 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67a54ece-9d66-4b52-8986-6f99c050bb0f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:33.754003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1d5e6007-9625-476e-98fa-dba194ffc50b tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d5474dc0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:33.784993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1d5e6007-9625-476e-98fa-dba194ffc50b tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.037932 Apr 07 17:55:33.785605 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 989/2111] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:33 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:55:34.797733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cbbc9ce6-606a-4dcf-bf5f-fe59201961c8 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d550a700>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:34.831430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cbbc9ce6-606a-4dcf-bf5f-fe59201961c8 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.035598 Apr 07 17:55:34.831430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 990/2112] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:34 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:55:35.842672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f45bbc48-f4e2-4cd0-b833-ad4364c0e68d tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d550a700>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:35.847550 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-67a54ece-9d66-4b52-8986-6f99c050bb0f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.119669 Apr 07 17:55:35.848166 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1123/2113] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:55:32 2022] POST /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments => generated 194 bytes in 3121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:55:35.873124 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f45bbc48-f4e2-4cd0-b833-ad4364c0e68d tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.035494 Apr 07 17:55:35.873741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 991/2114] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:35 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:55:36.886178 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f72cb77e-23f3-4827-b3b0-037ab92e924a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d54f3d30>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:36.929555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f72cb77e-23f3-4827-b3b0-037ab92e924a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.039587 Apr 07 17:55:36.929555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1124/2115] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:36 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:37.936982 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f3ec9e7b-624d-479c-a8f6-75229a2a2733 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d543a040>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:37.966586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f3ec9e7b-624d-479c-a8f6-75229a2a2733 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.033804 Apr 07 17:55:37.967504 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 992/2116] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:37 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:38.979648 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bcf985f0-a22d-494b-8de7-64627237783b tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0616940>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:39.008966 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bcf985f0-a22d-494b-8de7-64627237783b tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 286 microversion: 2.1 time: 0.034784 Apr 07 17:55:39.009586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1125/2117] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:38 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:39.024027 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3137c0bc-2ee5-4bdb-b5f0-ca13b35cc6e9 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0e9ddc0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:39.233873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3137c0bc-2ee5-4bdb-b5f0-ca13b35cc6e9 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 202 len: 0 microversion: 2.1 time: 0.217785 Apr 07 17:55:39.235542 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 993/2118] 10.222.0.26 () {58 vars in 1253 bytes} [Thu Apr 7 17:55:39 2022] DELETE /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:55:39.243224 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-68fc527c-b54c-4a78-88e7-3a986991c461 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d0483d30>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:39.297089 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-68fc527c-b54c-4a78-88e7-3a986991c461 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 200 len: 285 microversion: 2.1 time: 0.058346 Apr 07 17:55:39.297857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1126/2119] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:39 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 285 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:40.309769 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5f5185c9-cbde-41bd-9938-544bc690240a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d055aaf0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:40.334964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-5f5185c9-cbde-41bd-9938-544bc690240a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] HTTP exception thrown: Snapshot feac597a-f637-4195-b2d5-b1c1b0f8281d could not be found. Apr 07 17:55:40.344179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5f5185c9-cbde-41bd-9938-544bc690240a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Returning 404 to user: Snapshot feac597a-f637-4195-b2d5-b1c1b0f8281d could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:55:40.344179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5f5185c9-cbde-41bd-9938-544bc690240a tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d" status: 404 len: 111 microversion: 2.1 time: 0.032250 Apr 07 17:55:40.344179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 994/2120] 10.222.0.26 () {58 vars in 1250 bytes} [Thu Apr 7 17:55:40 2022] GET /compute/v2.1/os-snapshots/feac597a-f637-4195-b2d5-b1c1b0f8281d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:55:40.349870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3aee067c-f65d-4049-952d-4682c01ff3f6 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d04b74c0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:40.603938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3aee067c-f65d-4049-952d-4682c01ff3f6 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 202 len: 0 microversion: 2.1 time: 0.258557 Apr 07 17:55:40.605111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1127/2121] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:55:40 2022] DELETE /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 07 17:55:40.614460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f40a3256-fa05-448c-bd89-95de3b030625 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d53c6820>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:40.689588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f40a3256-fa05-448c-bd89-95de3b030625 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 200 len: 345 microversion: 2.1 time: 0.075196 Apr 07 17:55:40.689588 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 995/2122] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:40 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:41.699396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6946f9a7-0e28-4372-9052-324b209ad95e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d06f34c0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:41.726319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-6946f9a7-0e28-4372-9052-324b209ad95e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] HTTP exception thrown: Volume 3a22ed79-ff6c-4cd7-9c63-b14087e65cda could not be found. Apr 07 17:55:41.726926 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6946f9a7-0e28-4372-9052-324b209ad95e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Returning 404 to user: Volume 3a22ed79-ff6c-4cd7-9c63-b14087e65cda could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:55:41.727814 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6946f9a7-0e28-4372-9052-324b209ad95e tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 404 len: 109 microversion: 2.1 time: 0.033320 Apr 07 17:55:41.728364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1128/2123] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:41 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:55:41.745689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6cf20d6c-7bf6-4b88-998c-138d3f20e0c3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d5474c10>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:41.773288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-6cf20d6c-7bf6-4b88-998c-138d3f20e0c3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] HTTP exception thrown: Volume 3a22ed79-ff6c-4cd7-9c63-b14087e65cda could not be found. Apr 07 17:55:41.773911 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-6cf20d6c-7bf6-4b88-998c-138d3f20e0c3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Returning 404 to user: Volume 3a22ed79-ff6c-4cd7-9c63-b14087e65cda could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:55:41.775444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-6cf20d6c-7bf6-4b88-998c-138d3f20e0c3 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 404 len: 109 microversion: 2.1 time: 0.034142 Apr 07 17:55:41.775981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 996/2124] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:55:41 2022] DELETE /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:55:41.783970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-67c17e75-70a9-4c34-b9fe-c8b6bee68b51 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Calling method '.version_select at 0x7ff9d54d0160>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:41.812855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-67c17e75-70a9-4c34-b9fe-c8b6bee68b51 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] HTTP exception thrown: Volume 3a22ed79-ff6c-4cd7-9c63-b14087e65cda could not be found. Apr 07 17:55:41.813489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-67c17e75-70a9-4c34-b9fe-c8b6bee68b51 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] Returning 404 to user: Volume 3a22ed79-ff6c-4cd7-9c63-b14087e65cda could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:55:41.814968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-67c17e75-70a9-4c34-b9fe-c8b6bee68b51 tempest-VolumesSnapshotsTestJSON-1315198628 tempest-VolumesSnapshotsTestJSON-1315198628-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda" status: 404 len: 109 microversion: 2.1 time: 0.034138 Apr 07 17:55:41.814968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1129/2125] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:55:41 2022] GET /compute/v2.1/os-volumes/3a22ed79-ff6c-4cd7-9c63-b14087e65cda => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:55:46.517179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7c430f6-d1e5-472d-be37-b95cfaf72ccc"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:55:46.518562 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:46.527157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:46.527499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:46.528263 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:46.528694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:46.627584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Invalid volume: volume e7c430f6-d1e5-472d-be37-b95cfaf72ccc is already attached to instances: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd Apr 07 17:55:46.630090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 400 to user: Invalid volume: volume e7c430f6-d1e5-472d-be37-b95cfaf72ccc is already attached to instances: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:55:46.630477 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a132ade3-2444-492e-b6c4-02eca1291dbb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117505 Apr 07 17:55:46.631845 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 997/2126] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:55:46 2022] POST /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:55:46.704836 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:46.705743 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:46.712657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:46.713218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:46.714064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:46.714630 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:46.808863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'services' on Instance uuid 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:55:47.004592 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-da42cb82-73e0-4d4f-81d2-d6d2b69d65dd tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments/e7c430f6-d1e5-472d-be37-b95cfaf72ccc" status: 202 len: 0 microversion: 2.1 time: 0.304147 Apr 07 17:55:47.005545 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1130/2127] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:55:46 2022] DELETE /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments/e7c430f6-d1e5-472d-be37-b95cfaf72ccc => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:55:47.019995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-61471be1-7550-41e6-8296-ac2fe49aa697 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:47.020983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-61471be1-7550-41e6-8296-ac2fe49aa697 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:47.030353 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61471be1-7550-41e6-8296-ac2fe49aa697 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:47.030974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61471be1-7550-41e6-8296-ac2fe49aa697 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:47.031748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61471be1-7550-41e6-8296-ac2fe49aa697 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:47.032156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-61471be1-7550-41e6-8296-ac2fe49aa697 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:47.064674 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-61471be1-7550-41e6-8296-ac2fe49aa697 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050626 Apr 07 17:55:47.065290 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 998/2128] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:55:47 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:48.077719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9b7013bd-e3b0-4b18-a28a-76844f8acce9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:48.078800 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9b7013bd-e3b0-4b18-a28a-76844f8acce9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:48.085028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b7013bd-e3b0-4b18-a28a-76844f8acce9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:48.085511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b7013bd-e3b0-4b18-a28a-76844f8acce9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:48.086280 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b7013bd-e3b0-4b18-a28a-76844f8acce9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:48.088758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9b7013bd-e3b0-4b18-a28a-76844f8acce9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:48.119740 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9b7013bd-e3b0-4b18-a28a-76844f8acce9 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046820 Apr 07 17:55:48.121033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1131/2129] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:55:48 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 17:55:48.296691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:48.297268 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:48.311002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:48.311002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:48.311002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:48.311002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:48.345390 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:55:48.632468 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e6a66a85-5577-4c03-aa86-deea636e1c4b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 204 len: 0 microversion: 2.1 time: 0.341941 Apr 07 17:55:48.633072 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 999/2130] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:55:48 2022] DELETE /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:55:48.641704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:48.642315 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:48.648370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:48.648820 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:48.650331 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:48.650687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:48.811307 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:55:48.819161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6cbcf92b-133f-42a4-aeef-aef3b958a2a4 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1679 microversion: 2.1 time: 0.180911 Apr 07 17:55:48.819751 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1132/2131] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:55:48 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:55:49.851790 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:49.853843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:49.862752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:49.863439 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:49.864594 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:49.865029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:50.177525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:55:50.186311 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-05add427-0ce3-41bf-a547-e21c0939995f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1679 microversion: 2.1 time: 0.351786 Apr 07 17:55:50.187868 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1000/2132] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:55:49 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1679 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:55:51.205855 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:51.206469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:51.213124 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:51.215271 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:51.224810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:51.224810 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:51.310208 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:55:51.320289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-763c8188-7c55-463c-a754-a09cc5d1e942 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1612 microversion: 2.1 time: 0.118196 Apr 07 17:55:51.322174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1133/2133] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:55:51 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1612 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:55:51.542060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-805f29b2-7078-41fa-a77e-b0337c6c536c req-9463d109-5df0-41a3-970d-e505043272cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46ede5e5-772c-41d3-ae1c-2c65c0ef75cd", "name": "network-vif-deleted", "tag": "328f791a-41c2-46f0-a858-f451ca0f6a50"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:55:51.553431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-805f29b2-7078-41fa-a77e-b0337c6c536c req-9463d109-5df0-41a3-970d-e505043272cd service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:51.554210 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-805f29b2-7078-41fa-a77e-b0337c6c536c req-9463d109-5df0-41a3-970d-e505043272cd service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:51.566524 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-805f29b2-7078-41fa-a77e-b0337c6c536c req-9463d109-5df0-41a3-970d-e505043272cd service nova] Creating event network-vif-deleted:328f791a-41c2-46f0-a858-f451ca0f6a50 for instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd on hv-cinder-83699 Apr 07 17:55:51.577660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-805f29b2-7078-41fa-a77e-b0337c6c536c req-9463d109-5df0-41a3-970d-e505043272cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038245 Apr 07 17:55:51.578852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1001/2134] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:55:52.339337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:52.339975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:52.347043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:52.347705 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:52.348657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:52.353844 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:52.402605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:52.403333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:52.404753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:55:52.475027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:55:52.483754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8e74d5ad-a274-4286-b8fe-163e5ce8c56d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 200 len: 1330 microversion: 2.1 time: 0.148287 Apr 07 17:55:52.484542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1134/2135] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:55:52 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 1330 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:55:53.501883 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:53.502576 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:55:53.508844 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:53.509427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:53.510204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:53.510642 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:53.523929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd could not be found. Apr 07 17:55:53.525360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:55:53.526392 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2ccac22a-d7e4-46a1-894d-d8efff8e1c17 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 404 len: 111 microversion: 2.1 time: 0.029235 Apr 07 17:55:53.527116 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1002/2136] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:55:53 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:55:53.536641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6803ec45-d3fd-4b0d-9112-74d1d8afb7c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '.version_select at 0x7ff9d54e8040>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:55:53.662487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6803ec45-d3fd-4b0d-9112-74d1d8afb7c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-979528262" status: 202 len: 0 microversion: 2.1 time: 0.130938 Apr 07 17:55:53.663299 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1135/2137] 10.222.0.26 () {58 vars in 1217 bytes} [Thu Apr 7 17:55:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-979528262 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:55:54.565729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: .version_select at 0x7ff9d550a670>, body: {"keypair": {"name": "tempest-keypair-1235462196"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:55:54.580373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:55:54.586653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:55:54.630003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [3ed1f92a-cb7d-4867-95fc-b14e9c23c31f] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 17:55:55.641534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [3ed1f92a-cb7d-4867-95fc-b14e9c23c31f] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 38882. Apr 07 17:55:55.822677 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:55:55.826795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:55:55.863256 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1458e45b-ef5d-4a94-a107-9bef2924cd53 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.303374 Apr 07 17:55:55.864355 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1003/2138] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:55:54 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:55:58.960405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1764652386", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58c1b1c1-2571-4626-8cc0-8332d9fac8a8"}], "security_groups": [{"name": "tempest-securitygroup--1228406705"}], "key_name": "tempest-keypair-1235462196", "user_data": "}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:55:59.136879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] validate_networks() for [('58c1b1c1-2571-4626-8cc0-8332d9fac8a8', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:55:59.811759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:55:59.812189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:55:59.812669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:55:59.813083 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:55:59.813539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:55:59.823405 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:59.823858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:59.824645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:55:59.825120 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:55:59.858018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for project f0de5c5263634476bca59b25adb38136. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:55:59.858018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Getting quotas for user f5305bd33ef447c58f0568740ed15c78 and project f0de5c5263634476bca59b25adb38136. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:55:59.859213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:55:59.861596 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:56:00.004654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [2ff1cf98-c857-42d7-b200-79f5ba12ed7b] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 17:56:01.013272 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [2ff1cf98-c857-42d7-b200-79f5ba12ed7b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39018. Apr 07 17:56:01.020553 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b63c0ed6-a2b9-44e4-9dfc-6d8b28cd6bcc tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.063634 Apr 07 17:56:01.023358 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1136/2139] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:55:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 07 17:56:01.033701 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3e356511-5de1-437d-aa6b-c90338058bf0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:01.047729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3e356511-5de1-437d-aa6b-c90338058bf0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:01.111727 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3e356511-5de1-437d-aa6b-c90338058bf0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:01.121703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3e356511-5de1-437d-aa6b-c90338058bf0 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1242 microversion: 2.1 time: 0.092161 Apr 07 17:56:01.122341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1004/2140] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:01 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:02.138911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:02.139547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:02.147462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:02.147939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:02.148694 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:02.149196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:02.225522 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:02.239280 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1541c809-6f84-4158-bb06-edb8bd8bdca7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1246 microversion: 2.1 time: 0.103944 Apr 07 17:56:02.240442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1137/2141] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:02 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1246 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:03.256724 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:03.257529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:03.270354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:03.281928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:03.285783 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:03.285783 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:03.517954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:03.533866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-337ecacc-8c4f-454c-a8db-c64218a3eba7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1302 microversion: 2.1 time: 0.281297 Apr 07 17:56:03.546694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1005/2142] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:03 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1302 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:04.553465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:04.554874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:04.569992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:04.573298 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:04.574355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:04.575126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:04.734459 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:04.743333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3f666bc7-8408-4d18-9d24-fe879886fa72 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1300 microversion: 2.1 time: 0.193597 Apr 07 17:56:04.743912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1138/2143] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:04 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1300 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:05.762759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:05.763387 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:05.780999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:05.782064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:05.784058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:05.784695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:06.138800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:06.147011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-47f3b444-f2ce-4812-a3c7-dd827c5e69c7 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.389264 Apr 07 17:56:06.151428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1006/2144] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:05 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:06.728906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-afe16230-60fc-43df-8179-68d4d7e593ba req-12825639-884f-412f-b037-1b9b99ffa64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d17014-5691-45cf-81d0-520ecfe19658", "tag": "b925d82f-fb5e-487f-ad1e-72de768fd560"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:06.744699 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-afe16230-60fc-43df-8179-68d4d7e593ba req-12825639-884f-412f-b037-1b9b99ffa64d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:06.745597 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-afe16230-60fc-43df-8179-68d4d7e593ba req-12825639-884f-412f-b037-1b9b99ffa64d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:06.762093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-afe16230-60fc-43df-8179-68d4d7e593ba req-12825639-884f-412f-b037-1b9b99ffa64d service nova] Creating event network-changed:b925d82f-fb5e-487f-ad1e-72de768fd560 for instance 14d17014-5691-45cf-81d0-520ecfe19658 on hv-cinder-83699 Apr 07 17:56:06.771995 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-afe16230-60fc-43df-8179-68d4d7e593ba req-12825639-884f-412f-b037-1b9b99ffa64d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052199 Apr 07 17:56:06.773193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1139/2145] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:56:07.171169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:07.171819 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:07.179583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:07.180044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:07.181693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:07.182373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:07.403076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:07.413745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a19bdd8a-3904-4e23-afa1-95fd5e92dc63 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.249724 Apr 07 17:56:07.414319 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1007/2146] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:07 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:08.029504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6685fb6b-ead9-47b8-b367-b734c1e58d77 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Action: 'create', calling method: .version_select at 0x7ff9d54cbdc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1604466148"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:08.043467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-6685fb6b-ead9-47b8-b367-b734c1e58d77 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Getting quotas for project c5ec31cb0df4492eaff128c55923a768. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:56:08.047778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-6685fb6b-ead9-47b8-b367-b734c1e58d77 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Getting quotas for user dae0de85d01c49dba8bcd98fd2f2d18f and project c5ec31cb0df4492eaff128c55923a768. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:56:08.312561 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-6685fb6b-ead9-47b8-b367-b734c1e58d77 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Getting quotas for project c5ec31cb0df4492eaff128c55923a768. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:56:08.316171 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-6685fb6b-ead9-47b8-b367-b734c1e58d77 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Getting quotas for user dae0de85d01c49dba8bcd98fd2f2d18f and project c5ec31cb0df4492eaff128c55923a768. Resources: {'key_pairs'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:56:08.329082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6685fb6b-ead9-47b8-b367-b734c1e58d77 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.506249 Apr 07 17:56:08.329708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1140/2147] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:56:07 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:08.431431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:08.432591 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:08.439351 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:08.440018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:08.440964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:08.441586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:08.629332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:08.653617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-883e3ed8-c9af-4363-9491-af52907122ca tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.226091 Apr 07 17:56:08.663823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1008/2148] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:08 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:09.672104 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:09.673608 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:09.686568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:09.687194 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:09.688086 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:09.689747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:09.952355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:09.954753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fd3ae5d0-f1c5-4989-81ae-2ac1c5c31b09 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.286910 Apr 07 17:56:09.955330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1141/2149] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:09 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:10.973908 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:10.974570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:10.981700 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:10.982152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:10.988846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:10.988846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:11.143255 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:11.154430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-30dd5b1b-5960-4652-ac9c-17c815d01090 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.185405 Apr 07 17:56:11.155440 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1009/2150] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:10 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:12.172613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:12.173262 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:12.179687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:12.180147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:12.180968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:12.181436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:12.340482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:12.348579 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8f7de023-d265-4073-b120-90c874589407 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.179902 Apr 07 17:56:12.359114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1142/2151] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:12 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:13.366424 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:13.367246 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:13.374871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:13.375308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:13.376091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:13.376528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:13.588527 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:13.596167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1a2b181b-b4a4-4db8-b728-a5a3ad8991f6 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.233661 Apr 07 17:56:13.596820 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1010/2152] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:13 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:14.614673 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:14.615374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:14.622563 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:14.623013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:14.623958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:14.628948 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:14.778338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:14.785649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7478b580-df3b-4a68-afb7-03e21cf8270c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.175342 Apr 07 17:56:14.786204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1143/2153] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:14 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:56:15.802855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:15.803489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:15.810002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:15.810444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:15.811195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:15.811623 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:15.952720 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:15.959873 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-16d46f50-5756-45a7-bb2b-fb05dd288716 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.160982 Apr 07 17:56:15.960430 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1011/2154] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:15 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:16.160719 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-291912052", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:16.215244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] validate_networks() for None {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:56:16.303785 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-8efd2957-6b74-4d58-aade-2334bcbf8636 req-f546ba85-06c3-4c65-b7a4-4e86981a9b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d17014-5691-45cf-81d0-520ecfe19658", "name": "network-vif-plugged", "status": "completed", "tag": "b925d82f-fb5e-487f-ad1e-72de768fd560"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:16.312071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-8efd2957-6b74-4d58-aade-2334bcbf8636 req-f546ba85-06c3-4c65-b7a4-4e86981a9b91 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:16.312516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-8efd2957-6b74-4d58-aade-2334bcbf8636 req-f546ba85-06c3-4c65-b7a4-4e86981a9b91 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:16.324652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-8efd2957-6b74-4d58-aade-2334bcbf8636 req-f546ba85-06c3-4c65-b7a4-4e86981a9b91 service nova] Creating event network-vif-plugged:b925d82f-fb5e-487f-ad1e-72de768fd560 for instance 14d17014-5691-45cf-81d0-520ecfe19658 on hv-cinder-83699 Apr 07 17:56:16.330035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-8efd2957-6b74-4d58-aade-2334bcbf8636 req-f546ba85-06c3-4c65-b7a4-4e86981a9b91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036964 Apr 07 17:56:16.330610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1012/2155] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:56:16.500936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:56:16.501432 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:56:16.501909 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:56:16.502349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:56:16.502764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:56:16.513486 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:16.513941 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:16.514755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:16.515193 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:16.532125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Getting quotas for project 0bad06bd9d1c436f8741d43771f8b78d. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:56:16.537060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Getting quotas for user 6efc797d14fb40faa4d3e46abeb295f8 and project 0bad06bd9d1c436f8741d43771f8b78d. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:56:16.546793 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:56:16.549161 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:56:16.692494 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-57e1ba9e-1ce1-4797-810a-7d9aa33fa8f8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535407 Apr 07 17:56:16.693198 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1144/2156] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:56:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:56:16.704740 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e06d3dfb-51f9-4a03-8be8-6d90dcfa3d61 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:16.705703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e06d3dfb-51f9-4a03-8be8-6d90dcfa3d61 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:16.764071 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e06d3dfb-51f9-4a03-8be8-6d90dcfa3d61 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:16.771902 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e06d3dfb-51f9-4a03-8be8-6d90dcfa3d61 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1214 microversion: 2.1 time: 0.071426 Apr 07 17:56:16.772464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1013/2157] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:16 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:16.975811 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:16.976355 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:16.983707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:16.984157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:16.984936 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:16.985423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:17.127741 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:17.140573 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ea7ec0b4-4513-4940-b5ef-0b856f98b369 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1368 microversion: 2.1 time: 0.168481 Apr 07 17:56:17.140992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1145/2158] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:16 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:17.795802 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:17.796436 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:17.803489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:17.804214 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:17.805050 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:17.805474 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:17.864882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:17.872162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ab252e2c-f4c7-4a7f-9455-eb5a7ff1a0df tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1218 microversion: 2.1 time: 0.080355 Apr 07 17:56:17.872711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1014/2159] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:17 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:18.157971 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:18.158585 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:18.165189 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:18.165645 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:18.167308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:18.167750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:18.310325 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:18.320798 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-67587192-0ce8-4f27-b0fd-251306875d66 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1558 microversion: 2.1 time: 0.166791 Apr 07 17:56:18.322014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1146/2160] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:18 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:18.340337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ed412eed-942b-45bf-9d1b-4c799d8e9994 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:18.346389 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ed412eed-942b-45bf-9d1b-4c799d8e9994 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:18.346801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed412eed-942b-45bf-9d1b-4c799d8e9994 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:18.347252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed412eed-942b-45bf-9d1b-4c799d8e9994 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:18.348010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed412eed-942b-45bf-9d1b-4c799d8e9994 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:18.348444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed412eed-942b-45bf-9d1b-4c799d8e9994 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:18.441495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ed412eed-942b-45bf-9d1b-4c799d8e9994 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100983 Apr 07 17:56:18.441495 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1015/2161] 10.222.0.26 () {58 vars in 1274 bytes} [Thu Apr 7 17:56:18 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:56:18.891733 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:18.892828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:18.899220 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:18.899876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:18.901429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:18.901868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:18.983359 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:18.991308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fbff82ee-4021-43e5-9e34-9b7abb667fc7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1274 microversion: 2.1 time: 0.103622 Apr 07 17:56:18.992096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1147/2162] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:18 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:20.009245 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:20.010396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:20.016376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:20.016838 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:20.017691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:20.018424 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:20.077005 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-77da1dae-ae4e-4759-a7fd-45b508b25177 req-1522365f-64e0-4a07-9ccf-8bf3207bad40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14d17014-5691-45cf-81d0-520ecfe19658", "tag": "b925d82f-fb5e-487f-ad1e-72de768fd560"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:20.086664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-77da1dae-ae4e-4759-a7fd-45b508b25177 req-1522365f-64e0-4a07-9ccf-8bf3207bad40 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:20.090996 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-77da1dae-ae4e-4759-a7fd-45b508b25177 req-1522365f-64e0-4a07-9ccf-8bf3207bad40 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:20.109063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-77da1dae-ae4e-4759-a7fd-45b508b25177 req-1522365f-64e0-4a07-9ccf-8bf3207bad40 service nova] Creating event network-changed:b925d82f-fb5e-487f-ad1e-72de768fd560 for instance 14d17014-5691-45cf-81d0-520ecfe19658 on hv-cinder-83699 Apr 07 17:56:20.113569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-77da1dae-ae4e-4759-a7fd-45b508b25177 req-1522365f-64e0-4a07-9ccf-8bf3207bad40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041390 Apr 07 17:56:20.114758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1148/2163] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:56:20.122832 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:20.142388 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-7921ded2-e6dd-4d6b-a001-3c9fa094198b tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1272 microversion: 2.1 time: 0.137409 Apr 07 17:56:20.143051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1016/2164] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:20 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1272 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:21.162513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:21.163227 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:21.170568 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:21.171022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:21.172113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:21.172593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:21.362812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:21.371972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1181a1c5-a1d7-4ac3-9c73-c8471a738060 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.215827 Apr 07 17:56:21.372565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1149/2165] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:21 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:22.137969 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-d9624823-495c-4a96-9867-ee1a35be7f8a req-33496162-bcf7-4412-a3df-d19579f7a627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "893718b7-3dcf-4c44-96ab-d3ed170b2feb", "tag": "19ddcc58-0eab-45be-a004-6c4e44f0b4c0"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:22.149748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-d9624823-495c-4a96-9867-ee1a35be7f8a req-33496162-bcf7-4412-a3df-d19579f7a627 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:22.149748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-d9624823-495c-4a96-9867-ee1a35be7f8a req-33496162-bcf7-4412-a3df-d19579f7a627 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:22.157843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-d9624823-495c-4a96-9867-ee1a35be7f8a req-33496162-bcf7-4412-a3df-d19579f7a627 service nova] Creating event network-changed:19ddcc58-0eab-45be-a004-6c4e44f0b4c0 for instance 893718b7-3dcf-4c44-96ab-d3ed170b2feb on hv-cinder-83699 Apr 07 17:56:22.162557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-d9624823-495c-4a96-9867-ee1a35be7f8a req-33496162-bcf7-4412-a3df-d19579f7a627 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028890 Apr 07 17:56:22.163157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1017/2166] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:56:22.388840 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:22.389524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:22.396209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:22.396659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:22.397457 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:22.397895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:22.537080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:22.545790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3ea853ef-f925-4908-969c-e59b84b05486 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.161460 Apr 07 17:56:22.546372 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1150/2167] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:22 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:23.564119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:23.564816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:23.570899 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:23.571333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:23.572684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:23.573695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:23.709639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:23.717182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5ce7531b-3f4e-45fb-9df1-7352d6fde0af tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.157649 Apr 07 17:56:23.717765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1018/2168] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:23 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:24.734779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:24.735314 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:24.741661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:24.742097 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:24.742848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:24.743277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:24.871215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:24.878414 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d7328b6a-32ed-48f6-889e-0fc4da702e40 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.147600 Apr 07 17:56:24.878979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1151/2169] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:24 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:25.894828 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:25.895428 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:25.902356 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:25.902797 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:25.903557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:25.903985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:26.035374 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:26.043289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-23d7f4f4-3e37-46d1-aeda-7a48024188a1 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.152551 Apr 07 17:56:26.043851 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1019/2170] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:25 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:27.063348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:27.064661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:27.074547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:27.076108 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:27.077063 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:27.077894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:27.238796 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:27.246671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bf148037-2be5-42ab-a583-07a7ef3d2520 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.190233 Apr 07 17:56:27.247240 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1152/2171] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:27 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:28.264536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:28.265398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:28.271891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:28.272415 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:28.273280 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:28.273717 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:28.340454 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-04106157-c5aa-4ebb-adbd-88ebef3eee63 req-aeaaed90-869d-4762-889a-20fadc1123af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893718b7-3dcf-4c44-96ab-d3ed170b2feb", "name": "network-vif-plugged", "status": "completed", "tag": "19ddcc58-0eab-45be-a004-6c4e44f0b4c0"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:28.350008 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-04106157-c5aa-4ebb-adbd-88ebef3eee63 req-aeaaed90-869d-4762-889a-20fadc1123af service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:28.352962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-04106157-c5aa-4ebb-adbd-88ebef3eee63 req-aeaaed90-869d-4762-889a-20fadc1123af service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:28.361603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-04106157-c5aa-4ebb-adbd-88ebef3eee63 req-aeaaed90-869d-4762-889a-20fadc1123af service nova] Creating event network-vif-plugged:19ddcc58-0eab-45be-a004-6c4e44f0b4c0 for instance 893718b7-3dcf-4c44-96ab-d3ed170b2feb on hv-cinder-83699 Apr 07 17:56:28.366544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-04106157-c5aa-4ebb-adbd-88ebef3eee63 req-aeaaed90-869d-4762-889a-20fadc1123af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030525 Apr 07 17:56:28.367155 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1153/2172] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:56:28.411088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:28.419320 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2e1915ac-fc67-4a40-8a78-247d3ee80773 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.158668 Apr 07 17:56:28.428741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1020/2173] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:28 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:28.687731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1674381572", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1604466148", "security_groups": [{"name": "tempest-secgroup-smoke-984026109"}], "networks": [{"uuid": "69ed99ba-0f4b-4b9f-8946-970643f9b766"}], "block_device_mapping_v2": [{"uuid": "cad2299a-f14e-47af-a3e0-0f16272acaa0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:28.795264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] validate_networks() for [('69ed99ba-0f4b-4b9f-8946-970643f9b766', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:56:29.153157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:56:29.153600 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:56:29.154075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:56:29.154487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:56:29.154900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:56:29.163528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:29.163979 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:29.164774 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:29.165245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:29.183424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Getting quotas for project c5ec31cb0df4492eaff128c55923a768. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:56:29.187362 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Getting quotas for user dae0de85d01c49dba8bcd98fd2f2d18f and project c5ec31cb0df4492eaff128c55923a768. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:56:29.243466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:56:29.245956 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cad2299a-f14e-47af-a3e0-0f16272acaa0',volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:56:29.436662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:29.437286 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:29.443470 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:29.443919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:29.444682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:29.445117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:29.585621 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:29.594175 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b1711521-5caf-42b3-98be-965f901e0d09 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1314 microversion: 2.1 time: 0.161379 Apr 07 17:56:29.594752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1021/2174] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:29 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:56:29.600667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fd014d25-18ba-461d-a208-4a9f2e70cbd5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.914656 Apr 07 17:56:29.600667 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1154/2175] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:56:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:56:29.614261 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-313a1247-7d7f-414b-8717-7d34184743f6 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:29.616195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-313a1247-7d7f-414b-8717-7d34184743f6 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:29.676731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-313a1247-7d7f-414b-8717-7d34184743f6 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:29.685236 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-313a1247-7d7f-414b-8717-7d34184743f6 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1089 microversion: 2.1 time: 0.078244 Apr 07 17:56:29.685804 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1155/2176] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:29 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1089 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:30.611452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:30.612133 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:30.618597 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:30.619041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:30.620008 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:30.620475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:30.703174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:30.703790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:30.710476 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:30.713349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:30.713349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:30.713349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:30.775560 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:30.783931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5c0d6b3a-b3cb-4471-b715-4ae598d699d8 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1464 microversion: 2.1 time: 0.176450 Apr 07 17:56:30.796754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1022/2177] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:30 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1464 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:30.798649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:30.804528 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 17:56:30.805115 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 17:56:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 17:56:30.820968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d3432ac6-3195-46af-9f37-2e155d8ed6d2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1139 microversion: 2.1 time: 0.109991 Apr 07 17:56:30.821691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1156/2178] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:30 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1139 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:30.824315 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:30.824829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:30.836371 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:30.836918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:30.837796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:30.838337 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:30.864791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:56:31.187857 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f650c995-dd94-41eb-93db-72ac42d5aad2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "DELETE /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 204 len: 0 microversion: 2.1 time: 0.367161 Apr 07 17:56:31.188449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1023/2179] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:56:30 2022] DELETE /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 07 17:56:31.196482 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:31.197268 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:31.203664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:31.204110 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:31.204860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:31.205328 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:31.337919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:31.345778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f41853bc-7f5e-44f5-ac7c-e1ae9d466cf7 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1470 microversion: 2.1 time: 0.153109 Apr 07 17:56:31.346348 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1157/2180] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:31 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:31.838644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:31.839953 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:31.846316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:31.846761 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:31.847525 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:31.847958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:31.907165 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:31.914472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3431664b-81cf-4ed4-bba9-68dc07c86a3c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1187 microversion: 2.1 time: 0.080125 Apr 07 17:56:31.915023 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1024/2181] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:31 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1187 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:32.363556 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:32.364190 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:32.370442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:32.370902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:32.371657 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:32.372090 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:32.843018 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:32.851684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-65226b00-89a1-47ab-b7ea-8c1a6fadba38 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1470 microversion: 2.1 time: 0.491497 Apr 07 17:56:32.852622 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1158/2182] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:32 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1470 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:32.931454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:32.932066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:32.939688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:32.940497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:32.941557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:32.942257 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:33.034349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:33.041925 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-eb452d18-c8e4-470b-8a19-82deaad8a3c5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1205 microversion: 2.1 time: 0.114257 Apr 07 17:56:33.043056 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1025/2183] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:32 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1205 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:33.414041 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-38b09e49-5d62-4108-a868-646c4922174a req-f274ab2d-8ae6-47b4-a3ea-bbbcba85f507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "893718b7-3dcf-4c44-96ab-d3ed170b2feb", "name": "network-vif-deleted", "tag": "19ddcc58-0eab-45be-a004-6c4e44f0b4c0"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:33.422922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-38b09e49-5d62-4108-a868-646c4922174a req-f274ab2d-8ae6-47b4-a3ea-bbbcba85f507 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:33.423324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-38b09e49-5d62-4108-a868-646c4922174a req-f274ab2d-8ae6-47b4-a3ea-bbbcba85f507 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:33.436994 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-38b09e49-5d62-4108-a868-646c4922174a req-f274ab2d-8ae6-47b4-a3ea-bbbcba85f507 service nova] Creating event network-vif-deleted:19ddcc58-0eab-45be-a004-6c4e44f0b4c0 for instance 893718b7-3dcf-4c44-96ab-d3ed170b2feb on hv-cinder-83699 Apr 07 17:56:33.442735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-38b09e49-5d62-4108-a868-646c4922174a req-f274ab2d-8ae6-47b4-a3ea-bbbcba85f507 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180587 Apr 07 17:56:33.443344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1159/2184] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:56:33.869236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:33.869849 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:33.877344 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:33.877807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:33.878670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:33.879141 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:33.914906 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:33.915488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:33.915939 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lazy-loading 'fault' on Instance uuid 893718b7-3dcf-4c44-96ab-d3ed170b2feb {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:56:33.974521 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efc797d14fb40faa4d3e46abeb295f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bad06bd9d1c436f8741d43771f8b78d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:33.983481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-86006370-c9d2-48e6-a1b0-232303206daa tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 200 len: 1304 microversion: 2.1 time: 0.118134 Apr 07 17:56:33.984062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1026/2185] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:33 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:34.061396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:34.065017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:34.068310 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:34.068754 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:34.069543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:34.069975 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:34.303574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:34.312581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4ae77269-4aa0-471a-8295-0c0f694bafc4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.256369 Apr 07 17:56:34.313620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1160/2186] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:34 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:34.693401 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-74264ac5-5a00-4936-a74d-7d9e977eba4b req-c1234f8a-afa9-41cd-9d39-cf7db29f5d9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6", "tag": "456e5900-67cf-48e8-9c4b-59a82256ebb7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:34.703362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-74264ac5-5a00-4936-a74d-7d9e977eba4b req-c1234f8a-afa9-41cd-9d39-cf7db29f5d9d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:34.703806 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-74264ac5-5a00-4936-a74d-7d9e977eba4b req-c1234f8a-afa9-41cd-9d39-cf7db29f5d9d service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:34.716231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-74264ac5-5a00-4936-a74d-7d9e977eba4b req-c1234f8a-afa9-41cd-9d39-cf7db29f5d9d service nova] Creating event network-changed:456e5900-67cf-48e8-9c4b-59a82256ebb7 for instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 on hv-cinder-83699 Apr 07 17:56:34.721275 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-74264ac5-5a00-4936-a74d-7d9e977eba4b req-c1234f8a-afa9-41cd-9d39-cf7db29f5d9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037078 Apr 07 17:56:34.721840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1027/2187] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:56:34.999972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:35.001330 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] [instance: 893718b7-3dcf-4c44-96ab-d3ed170b2feb] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:35.007702 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:35.008147 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:35.008907 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:35.009367 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:35.024586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] HTTP exception thrown: Instance 893718b7-3dcf-4c44-96ab-d3ed170b2feb could not be found. Apr 07 17:56:35.025200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] Returning 404 to user: Instance 893718b7-3dcf-4c44-96ab-d3ed170b2feb could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:56:35.026111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b9cfd6f2-3ac5-4bfc-aa32-3e33c6fd7da2 tempest-VolumesNegativeTest-738179063 tempest-VolumesNegativeTest-738179063-project] 10.222.0.26 "GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb" status: 404 len: 111 microversion: 2.1 time: 0.030203 Apr 07 17:56:35.026655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1161/2188] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:34 2022] GET /compute/v2.1/servers/893718b7-3dcf-4c44-96ab-d3ed170b2feb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:56:35.332262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:35.332964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:35.339950 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:35.340448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:35.345640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:35.345640 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:35.511037 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:35.519188 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-060ba219-8519-4f13-b6f3-996fa460decd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.191653 Apr 07 17:56:35.521891 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1028/2189] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:35 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:36.535824 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:36.536361 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:36.543031 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:36.543483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:36.544868 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:36.545333 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:36.694584 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:36.703286 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a0c4af31-1dc8-4589-8b7b-0e4f59fa3694 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.171424 Apr 07 17:56:36.704174 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1162/2190] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:36 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:37.724252 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:37.725020 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:37.733184 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:37.733712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:37.734547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:37.734979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:37.874079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:37.881443 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a439d66e-b547-4f7f-8728-d6ad494afeae tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.165601 Apr 07 17:56:37.882011 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1029/2191] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:37 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:38.898599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:38.899238 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:38.905543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:38.906139 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:38.906935 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:38.907514 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:39.046934 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:39.054248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3dd58ddb-056b-47cc-8737-779c3ef328ef tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.159655 Apr 07 17:56:39.054812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1163/2192] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:38 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:40.076738 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:40.077399 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:40.083643 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:40.084083 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:40.084842 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:40.085289 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:40.218102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:40.225748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3b46bfc1-0844-4cf1-9500-9b6176939fad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.153820 Apr 07 17:56:40.226627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1030/2193] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:40 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:41.288141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:41.288141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:41.288141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:41.288141 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:41.288925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:41.288925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:41.390813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:41.398443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e2bd53f5-6662-4da8-b1f7-55519b8314a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.159782 Apr 07 17:56:41.403133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1164/2194] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:41 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:42.415706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:42.416329 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:42.423316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:42.425034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:42.425034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:42.425034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:42.627168 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:42.635808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cf4dec48-9b21-4482-878e-db39530658a0 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.222955 Apr 07 17:56:42.635808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1031/2195] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:42 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:43.652708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:43.654916 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:43.662364 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:43.662987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:43.663761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:43.664197 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:43.973846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:43.983535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7dd1336c-4de0-4c73-be3a-48d8a5d2493b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.335412 Apr 07 17:56:43.984128 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1165/2196] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:43 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:45.001429 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:45.002078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:45.007928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:45.008617 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:45.009421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:45.009825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:45.246969 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:45.259678 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-af3d6888-5045-4cb4-83e2-344c2380c4f2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.262362 Apr 07 17:56:45.260469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1032/2197] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:44 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:56:46.279542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:46.280797 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:46.286783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:46.287231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:46.287999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:46.288483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:46.455837 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-9c0ccc2c-ccf5-4ac4-a342-947fa815d620 req-35e3eb1e-95a2-4c90-a215-5eb76034c9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6", "name": "network-vif-plugged", "status": "completed", "tag": "456e5900-67cf-48e8-9c4b-59a82256ebb7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:46.465613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-9c0ccc2c-ccf5-4ac4-a342-947fa815d620 req-35e3eb1e-95a2-4c90-a215-5eb76034c9a9 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:46.466856 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-9c0ccc2c-ccf5-4ac4-a342-947fa815d620 req-35e3eb1e-95a2-4c90-a215-5eb76034c9a9 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:46.478593 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-9c0ccc2c-ccf5-4ac4-a342-947fa815d620 req-35e3eb1e-95a2-4c90-a215-5eb76034c9a9 service nova] Creating event network-vif-plugged:456e5900-67cf-48e8-9c4b-59a82256ebb7 for instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 on hv-cinder-83699 Apr 07 17:56:46.484653 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-9c0ccc2c-ccf5-4ac4-a342-947fa815d620 req-35e3eb1e-95a2-4c90-a215-5eb76034c9a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 Apr 07 17:56:46.487332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1033/2198] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:56:46.543524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:46.554383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6c4e2b84-8912-4427-af09-1a49bb8b53ba tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.279815 Apr 07 17:56:46.562684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1166/2199] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:46 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:47.572883 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:47.573619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:47.580242 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:47.580693 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:47.581483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:47.581917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:47.734365 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:47.742167 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c45403f6-c285-4c5f-8e98-602c6388fb33 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1260 microversion: 2.1 time: 0.174008 Apr 07 17:56:47.742731 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1034/2200] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:47 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:48.759022 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:48.759639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:48.766621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:48.767074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:48.767885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:48.768444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:48.921442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:48.929279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-098d3b50-bb04-4f56-8ff8-083c4bcad90f tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1444 microversion: 2.1 time: 0.174153 Apr 07 17:56:48.929951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1167/2201] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:48 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1444 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:56:48.950361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:48.950361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:48.956269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:48.956948 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:48.957716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:48.958147 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:49.106995 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:56:49.118325 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-62dd7222-be8c-40df-b2ab-bb2d1f6da278 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1444 microversion: 2.1 time: 0.176686 Apr 07 17:56:49.119733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1035/2202] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:56:48 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1444 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:56:51.664646 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-f5c3a586-01ec-439d-9f27-2795c3b4a92f req-1a49e2d3-6277-447b-b6e5-68e34d6cd4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6", "tag": "456e5900-67cf-48e8-9c4b-59a82256ebb7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:51.674878 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-f5c3a586-01ec-439d-9f27-2795c3b4a92f req-1a49e2d3-6277-447b-b6e5-68e34d6cd4d3 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:51.675439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-f5c3a586-01ec-439d-9f27-2795c3b4a92f req-1a49e2d3-6277-447b-b6e5-68e34d6cd4d3 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:51.687399 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-f5c3a586-01ec-439d-9f27-2795c3b4a92f req-1a49e2d3-6277-447b-b6e5-68e34d6cd4d3 service nova] Creating event network-changed:456e5900-67cf-48e8-9c4b-59a82256ebb7 for instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 on hv-cinder-83699 Apr 07 17:56:51.693879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-f5c3a586-01ec-439d-9f27-2795c3b4a92f req-1a49e2d3-6277-447b-b6e5-68e34d6cd4d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032519 Apr 07 17:56:51.694750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1168/2203] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:56:56.424070 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-47a10bd2-da96-4c45-8d45-0d517328471f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:56:56.425223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-47a10bd2-da96-4c45-8d45-0d517328471f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:56.431644 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47a10bd2-da96-4c45-8d45-0d517328471f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:56.432322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47a10bd2-da96-4c45-8d45-0d517328471f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:56.433306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47a10bd2-da96-4c45-8d45-0d517328471f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:56.433754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-47a10bd2-da96-4c45-8d45-0d517328471f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:56.461846 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-47a10bd2-da96-4c45-8d45-0d517328471f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/ips" status: 200 len: 149 microversion: 2.1 time: 0.341144 Apr 07 17:56:56.462734 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1036/2204] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:56:56 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/ips => generated 149 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:56:58.213925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-26c6b009-4adf-47f7-8958-728c0e701e02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1351eaf7-224b-4270-bb3b-0bc4e72a2309"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:56:58.215230 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-26c6b009-4adf-47f7-8958-728c0e701e02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:56:58.223721 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26c6b009-4adf-47f7-8958-728c0e701e02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:58.224184 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26c6b009-4adf-47f7-8958-728c0e701e02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:58.224967 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26c6b009-4adf-47f7-8958-728c0e701e02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:56:58.225439 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-26c6b009-4adf-47f7-8958-728c0e701e02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:56:59.226094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-26c6b009-4adf-47f7-8958-728c0e701e02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "POST /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.017897 Apr 07 17:56:59.226882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1169/2205] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:56:58 2022] POST /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments => generated 194 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:05.314217 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c9bda5bb-cf92-4ab4-bfc3-45c1c895839f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Action: 'create', calling method: .version_select at 0x7ff9d04bd310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2094675761"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:05.328750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c9bda5bb-cf92-4ab4-bfc3-45c1c895839f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Getting quotas for project d168a51bad674c2ca599b3e27294fa4c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:57:05.332601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c9bda5bb-cf92-4ab4-bfc3-45c1c895839f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Getting quotas for user 0f42148ef13141eeb456a7639564f74e and project d168a51bad674c2ca599b3e27294fa4c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:57:05.763452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c9bda5bb-cf92-4ab4-bfc3-45c1c895839f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Getting quotas for project d168a51bad674c2ca599b3e27294fa4c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:57:05.767112 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-c9bda5bb-cf92-4ab4-bfc3-45c1c895839f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Getting quotas for user 0f42148ef13141eeb456a7639564f74e and project d168a51bad674c2ca599b3e27294fa4c. Resources: {'key_pairs'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:57:05.779886 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c9bda5bb-cf92-4ab4-bfc3-45c1c895839f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.470179 Apr 07 17:57:05.786160 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1037/2206] 10.222.0.26 () {60 vars in 1157 bytes} [Thu Apr 7 17:57:05 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:05.829516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-980487118", "imageRef": "79e023a4-b3b5-42b5-aad5-8011db0eb4d7", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2094675761", "networks": [{"uuid": "8b6b6ca8-5588-4d4a-ba71-295d2dfb3aea"}]}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:05.879912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] validate_networks() for [('8b6b6ca8-5588-4d4a-ba71-295d2dfb3aea', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:57:06.261738 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:57:06.267158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:57:06.267158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:57:06.267158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:57:06.267158 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:57:06.272477 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:06.272917 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:06.273746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:06.274180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:06.290339 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Getting quotas for project d168a51bad674c2ca599b3e27294fa4c. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:57:06.294185 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Getting quotas for user 0f42148ef13141eeb456a7639564f74e and project d168a51bad674c2ca599b3e27294fa4c. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:57:06.305259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:57:06.307489 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='79e023a4-b3b5-42b5-aad5-8011db0eb4d7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:57:06.417064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-8e9244ca-c13b-4d7f-b9ff-a7b3366f9378 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.592184 Apr 07 17:57:06.417989 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1170/2207] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:57:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:57:06.429453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b36138da-f6a0-456c-802a-9a05a7fe5c49 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:06.430060 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b36138da-f6a0-456c-802a-9a05a7fe5c49 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:06.481766 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b36138da-f6a0-456c-802a-9a05a7fe5c49 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:06.489842 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b36138da-f6a0-456c-802a-9a05a7fe5c49 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1258 microversion: 2.1 time: 0.064742 Apr 07 17:57:06.490395 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1038/2208] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:06 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:06.842378 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:06.842901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:06.849279 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:06.849724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:06.850542 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:06.850978 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:06.932140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'services' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:07.179687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-016dca0c-00cf-4899-84d2-24e0152e20fb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments/1351eaf7-224b-4270-bb3b-0bc4e72a2309" status: 202 len: 0 microversion: 2.1 time: 0.341975 Apr 07 17:57:07.183397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1171/2209] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:57:06 2022] DELETE /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments/1351eaf7-224b-4270-bb3b-0bc4e72a2309 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:57:07.189150 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-740c1386-91ff-4ac4-ad32-7e556337d0a1 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:07.190094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-740c1386-91ff-4ac4-ad32-7e556337d0a1 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:07.195913 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-740c1386-91ff-4ac4-ad32-7e556337d0a1 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:07.199604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-740c1386-91ff-4ac4-ad32-7e556337d0a1 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:07.199604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-740c1386-91ff-4ac4-ad32-7e556337d0a1 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:07.199604 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-740c1386-91ff-4ac4-ad32-7e556337d0a1 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:07.226874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-740c1386-91ff-4ac4-ad32-7e556337d0a1 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042004 Apr 07 17:57:07.227419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1039/2210] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:57:07 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:07.507498 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:07.508240 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:07.515569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:07.516111 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:07.516925 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:07.517376 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:07.578321 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:07.585586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-309d9321-b10e-4874-ba5f-6ec233f71478 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1262 microversion: 2.1 time: 0.082291 Apr 07 17:57:07.586153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1172/2211] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:07 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:08.239622 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-10447371-2bf6-4940-9a64-0db85fe72b02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:08.240536 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-10447371-2bf6-4940-9a64-0db85fe72b02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:08.246850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10447371-2bf6-4940-9a64-0db85fe72b02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.247291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10447371-2bf6-4940-9a64-0db85fe72b02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.248079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10447371-2bf6-4940-9a64-0db85fe72b02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.248993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-10447371-2bf6-4940-9a64-0db85fe72b02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.276757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-10447371-2bf6-4940-9a64-0db85fe72b02 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041066 Apr 07 17:57:08.277327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1040/2212] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:57:08 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 17:57:08.335879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:08.337074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:08.344474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.344920 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.348177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.348177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.377318 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:57:08.603066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:08.603706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:08.609781 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.610448 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.611224 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.611663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.657823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f204957c-d473-44b4-89b4-e3af83fe2c48 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 204 len: 0 microversion: 2.1 time: 0.327637 Apr 07 17:57:08.658420 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1173/2213] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:57:08 2022] DELETE /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:57:08.667408 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:08.668118 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:08.678259 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.678710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.679485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:08.679919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:08.688122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:08.696321 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c0ffe1d9-4e9a-49c4-a077-ff58a75928d4 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1318 microversion: 2.1 time: 0.097098 Apr 07 17:57:08.697029 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1041/2214] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:08 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1318 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:57:08.838974 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:08.847055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b27247cc-f837-4945-8666-8636ed37e758 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1682 microversion: 2.1 time: 0.183882 Apr 07 17:57:08.847828 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1174/2215] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:08 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:57:09.714055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:09.714692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:09.721240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:09.721690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:09.722451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:09.722887 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:09.853917 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:09.861709 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dd178f54-6e1e-4c42-93f5-40363a16e119 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1370 microversion: 2.1 time: 0.151468 Apr 07 17:57:09.862265 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1042/2216] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:09 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:09.864257 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:09.864863 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:09.871182 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:09.871633 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:09.872394 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:09.872827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:10.066535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:10.073914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b09316c6-595b-413e-94cc-5757b0117abb tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1682 microversion: 2.1 time: 0.213398 Apr 07 17:57:10.079541 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1175/2217] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:09 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:57:10.880370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:10.881850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:10.891341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:10.891341 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:10.891822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:10.892491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:11.092510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:11.094200 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:11.109043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:11.109524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:11.110574 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:11.111212 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:11.238602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:11.247232 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f061b809-3b2b-48d9-8d71-ab17c7580f43 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1614 microversion: 2.1 time: 0.159343 Apr 07 17:57:11.258644 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1176/2218] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:11 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1614 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:11.268997 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:11.278386 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-4ba12d5e-d9bb-4994-8b3d-98aaeda13362 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.401939 Apr 07 17:57:11.279091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1043/2219] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:10 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:11.462175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-e29f0616-90f6-45c4-9263-b65f0e395664 req-d9fd0bc0-506c-46fc-ad7c-58a349c084ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7385f-9b6d-4b80-9e25-a00eac56f8b8", "tag": "3ce57ef8-b241-4169-abac-f60c31bd09b7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:11.481903 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-e29f0616-90f6-45c4-9263-b65f0e395664 req-d9fd0bc0-506c-46fc-ad7c-58a349c084ed service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:11.485516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-e29f0616-90f6-45c4-9263-b65f0e395664 req-d9fd0bc0-506c-46fc-ad7c-58a349c084ed service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:11.503441 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-affcef43-84b4-459f-a8dc-6f5e768e8a0a req-85ee0ec0-6ed2-4f6e-8add-830608ca06b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14d17014-5691-45cf-81d0-520ecfe19658", "name": "network-vif-deleted", "tag": "b925d82f-fb5e-487f-ad1e-72de768fd560"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:11.515469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-affcef43-84b4-459f-a8dc-6f5e768e8a0a req-85ee0ec0-6ed2-4f6e-8add-830608ca06b3 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:11.518225 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-e29f0616-90f6-45c4-9263-b65f0e395664 req-d9fd0bc0-506c-46fc-ad7c-58a349c084ed service nova] Creating event network-changed:3ce57ef8-b241-4169-abac-f60c31bd09b7 for instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 on hv-cinder-83699 Apr 07 17:57:11.518744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-affcef43-84b4-459f-a8dc-6f5e768e8a0a req-85ee0ec0-6ed2-4f6e-8add-830608ca06b3 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:11.524326 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-e29f0616-90f6-45c4-9263-b65f0e395664 req-d9fd0bc0-506c-46fc-ad7c-58a349c084ed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066375 Apr 07 17:57:11.528068 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1177/2220] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:11.540066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-affcef43-84b4-459f-a8dc-6f5e768e8a0a req-85ee0ec0-6ed2-4f6e-8add-830608ca06b3 service nova] Creating event network-vif-deleted:b925d82f-fb5e-487f-ad1e-72de768fd560 for instance 14d17014-5691-45cf-81d0-520ecfe19658 on hv-cinder-83699 Apr 07 17:57:11.556692 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-affcef43-84b4-459f-a8dc-6f5e768e8a0a req-85ee0ec0-6ed2-4f6e-8add-830608ca06b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058419 Apr 07 17:57:11.595788 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1044/2221] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:57:12.266703 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:12.267502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:12.274656 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:12.275624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:12.276650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:12.277418 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:12.300211 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:12.300964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:12.312877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:12.313434 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:12.313613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:12.314557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:12.315319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:12.320285 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:12.320826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:12.389544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:12.405569 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2668b01a-4a09-4c1e-8367-6f99c3e7d268 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.138983 Apr 07 17:57:12.406643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1178/2222] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:12 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:12.603583 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:12.612703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-48003397-be89-47c0-908f-458e325a87b7 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.320445 Apr 07 17:57:12.624878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1045/2223] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:12 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:13.423953 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:13.424559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:13.432062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:13.432764 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:13.433627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:13.434130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:13.472586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:13.473323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:13.474140 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:13.517732 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:13.526615 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1d6987c1-5ced-49ad-997c-c8de3fd2ca8f tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.106997 Apr 07 17:57:13.527537 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1179/2224] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:13 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:13.632762 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:13.634465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:13.642824 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:13.643463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:13.644675 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:13.645288 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:13.828350 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:13.831670 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5eb5ab2b-7be3-4358-8bb2-9b8b43e2c269 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.202210 Apr 07 17:57:13.831854 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1046/2225] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:13 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:14.544665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:14.545862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:14.552278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:14.552730 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:14.553549 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:14.553984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:14.586427 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:14.586794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:14.587244 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:14.637666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:14.645270 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e7e9071b-f932-4fdc-97d1-18742d1ef2ff tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.104460 Apr 07 17:57:14.646301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1180/2226] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:14 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:57:14.854867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:14.856357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:14.863764 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:14.864362 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:14.865240 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:14.865745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:15.016747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:15.025062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fc4e7208-f6a5-4658-a014-728f1a17ee59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.174222 Apr 07 17:57:15.026025 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1047/2227] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:14 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:15.667509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:15.668132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:15.676115 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:15.677028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:15.678045 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:15.678490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:15.713876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:15.714599 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:15.715256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:15.758055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:15.766564 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-58766bbb-72f5-4690-90b3-f550f498c831 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.107007 Apr 07 17:57:15.767165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1181/2228] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:15 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:16.042684 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:16.043308 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:16.050359 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:16.050811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:16.051601 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:16.052039 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:16.207262 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:16.214630 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-537df248-caea-4af9-9193-dcecf7b42bf5 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.176061 Apr 07 17:57:16.215195 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1048/2229] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:16 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:16.784504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:16.785258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:16.792215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:16.792745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:16.793670 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:16.794199 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:16.828899 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:16.829388 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:16.829860 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:16.872308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:16.880819 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-dc920f30-c182-418e-9358-4f71779b2b44 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.100153 Apr 07 17:57:16.881901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1182/2230] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:16 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:17.231791 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:17.233088 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:17.239938 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:17.240411 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:17.241174 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:17.241610 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:17.381509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:17.388877 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ea6e7bce-8087-41c9-9b5c-35026c5b4050 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.161012 Apr 07 17:57:17.389683 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1049/2231] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:17 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:57:17.898665 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:17.899264 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:17.906805 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:17.907274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:17.908131 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:17.908643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:17.940704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:17.941290 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:17.941827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:17.982618 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:17.990060 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4983233b-7e3b-4628-a2e1-0a8070390a3c tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.095646 Apr 07 17:57:17.990620 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1183/2232] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:17 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:18.407584 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:18.408209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:18.414629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:18.415073 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:18.415835 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:18.416264 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:18.562234 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:18.569513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-48fb1c8d-039a-455f-bdd0-0c7165c15043 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.166949 Apr 07 17:57:18.570078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1050/2233] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:18 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:19.007792 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:19.008491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:19.015565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:19.016011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:19.016781 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:19.017251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:19.047838 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:19.048280 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:19.048779 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:19.089687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:19.097114 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-72173dc5-3f32-41ae-8d90-67c6f27b7c6b tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.093191 Apr 07 17:57:19.097696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1184/2234] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:19 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:19.587711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:19.588327 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:19.594848 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:19.595298 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:19.596064 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:19.596503 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:19.730472 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:19.738405 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c9d8f04f-cd45-42fe-bb65-1b7762d6a54b tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.154545 Apr 07 17:57:19.738975 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1051/2235] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:19 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:20.115696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:20.116301 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:20.122570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:20.123650 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:20.125338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:20.125778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:20.157094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:20.157485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:20.157930 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lazy-loading 'fault' on Instance uuid 14d17014-5691-45cf-81d0-520ecfe19658 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:57:20.196961 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5305bd33ef447c58f0568740ed15c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0de5c5263634476bca59b25adb38136', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:20.204886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d61d3a1a-3525-451f-aadd-6a75bfecbe94 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 200 len: 1332 microversion: 2.1 time: 0.093002 Apr 07 17:57:20.206572 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1185/2236] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:20 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:20.755290 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:20.755898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:20.762090 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:20.762544 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:20.763312 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:20.763754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:20.894479 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:20.901901 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-66eaea80-03c9-4d39-8dcf-d250ec9a5dcd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.150584 Apr 07 17:57:20.902465 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1052/2237] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:20 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:21.222123 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:21.222724 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:21.228972 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:21.229452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:21.230213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:21.230651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:21.243500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance 14d17014-5691-45cf-81d0-520ecfe19658 could not be found. Apr 07 17:57:21.244078 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance 14d17014-5691-45cf-81d0-520ecfe19658 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:21.244894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-24ccaae9-28bd-4c4c-ab64-ddaa23aa0530 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 404 len: 111 microversion: 2.1 time: 0.026732 Apr 07 17:57:21.245452 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1186/2238] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:21 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:21.254154 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3b309265-1c49-437f-ad72-f105fe2ccd64 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '.version_select at 0x7ff9d055a4c0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:21.366032 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3b309265-1c49-437f-ad72-f105fe2ccd64 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235462196" status: 202 len: 0 microversion: 2.1 time: 0.115647 Apr 07 17:57:21.366586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1053/2239] 10.222.0.26 () {58 vars in 1220 bytes} [Thu Apr 7 17:57:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235462196 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:57:21.920400 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:21.921788 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:21.927922 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:21.928256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:21.929033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:21.929496 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:22.096071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:22.101749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e41f12d3-9a8b-4c1a-8c96-c29bbb1a71a2 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.186253 Apr 07 17:57:22.102319 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1187/2240] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:21 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:23.120861 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:23.121499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:23.128358 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:23.128804 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:23.129599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:23.130041 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:23.267035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:23.274559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0d0272a4-69e8-4cd9-b33b-64530b4bc252 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.158064 Apr 07 17:57:23.275117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1054/2241] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:23 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:23.412210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:23.412704 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:23.418986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:23.419435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:23.420513 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:23.420952 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:23.434044 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance 14d17014-5691-45cf-81d0-520ecfe19658 could not be found. Apr 07 17:57:23.434612 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance 14d17014-5691-45cf-81d0-520ecfe19658 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:23.436028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7eee40cf-2776-4108-a979-99453c17d991 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 404 len: 111 microversion: 2.1 time: 0.027113 Apr 07 17:57:23.436737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1188/2242] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:57:23 2022] DELETE /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:23.444334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:23.444945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 14d17014-5691-45cf-81d0-520ecfe19658] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:23.450691 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:23.451782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:23.452545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:23.452974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:23.466021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance 14d17014-5691-45cf-81d0-520ecfe19658 could not be found. Apr 07 17:57:23.466619 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance 14d17014-5691-45cf-81d0-520ecfe19658 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:23.467452 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d1f08963-abb6-43be-98a9-2133be9d729d tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658" status: 404 len: 111 microversion: 2.1 time: 0.026892 Apr 07 17:57:23.468146 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1055/2243] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:23 2022] GET /compute/v2.1/servers/14d17014-5691-45cf-81d0-520ecfe19658 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:24.292196 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:24.292790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:24.298881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:24.299335 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:24.300100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:24.300536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:24.432661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:24.440621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-6866eda1-f9be-44c6-b1b4-393ae0eaa038 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.152342 Apr 07 17:57:24.441213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1189/2244] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:24 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:24.728932 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:24.729464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:24.736497 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:24.737015 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:24.737833 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:24.738274 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:24.751346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd could not be found. Apr 07 17:57:24.751929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:24.752746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-31e65383-cd20-4b63-92e2-6d689ccd18cf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 404 len: 111 microversion: 2.1 time: 0.027735 Apr 07 17:57:24.753299 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1056/2245] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:57:24 2022] DELETE /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:24.761032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:24.761707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:24.767539 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:24.767990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:24.768749 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:24.769219 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:24.783503 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd could not be found. Apr 07 17:57:24.784092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance 46ede5e5-772c-41d3-ae1c-2c65c0ef75cd could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:24.784912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-bb677a65-7535-4ebe-bea1-5417b58155bf tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd" status: 404 len: 111 microversion: 2.1 time: 0.027709 Apr 07 17:57:24.785483 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1190/2246] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:24 2022] GET /compute/v2.1/servers/46ede5e5-772c-41d3-ae1c-2c65c0ef75cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:25.457810 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:25.458419 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:25.464126 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:25.464569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:25.465396 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:25.465834 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:25.596600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:25.603978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-01969a13-5c21-4c41-b64c-797166f31c59 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.150116 Apr 07 17:57:25.604530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1057/2247] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:25 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:26.038455 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:26.039002 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:26.045750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:26.046297 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:26.047075 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:26.047516 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:26.062937 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance c48b4307-c086-46c4-8f80-a445cf7c63a9 could not be found. Apr 07 17:57:26.063534 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance c48b4307-c086-46c4-8f80-a445cf7c63a9 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:26.064375 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-d0530c77-96d5-4637-bb91-bb246a6264f8 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 404 len: 111 microversion: 2.1 time: 0.029775 Apr 07 17:57:26.064902 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1191/2248] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:57:26 2022] DELETE /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:26.072697 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:26.073343 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] [instance: c48b4307-c086-46c4-8f80-a445cf7c63a9] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:26.080035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:26.080489 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:26.081300 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:26.081733 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:26.095680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] HTTP exception thrown: Instance c48b4307-c086-46c4-8f80-a445cf7c63a9 could not be found. Apr 07 17:57:26.096279 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] Returning 404 to user: Instance c48b4307-c086-46c4-8f80-a445cf7c63a9 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:26.097104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c845b5b3-aec7-49f4-8a54-362bd8ff7156 tempest-AttachVolumeNegativeTest-1945897997 tempest-AttachVolumeNegativeTest-1945897997-project] 10.222.0.26 "GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9" status: 404 len: 111 microversion: 2.1 time: 0.028207 Apr 07 17:57:26.108248 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1058/2249] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:26 2022] GET /compute/v2.1/servers/c48b4307-c086-46c4-8f80-a445cf7c63a9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:26.584258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-112c418e-96b3-4360-8cae-fdc92dda9a75 req-f5d2bc4c-02bd-46a4-9c13-1f5032380b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc7385f-9b6d-4b80-9e25-a00eac56f8b8", "name": "network-vif-plugged", "status": "completed", "tag": "3ce57ef8-b241-4169-abac-f60c31bd09b7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:26.593396 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-112c418e-96b3-4360-8cae-fdc92dda9a75 req-f5d2bc4c-02bd-46a4-9c13-1f5032380b17 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:26.593846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-112c418e-96b3-4360-8cae-fdc92dda9a75 req-f5d2bc4c-02bd-46a4-9c13-1f5032380b17 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:26.605040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-112c418e-96b3-4360-8cae-fdc92dda9a75 req-f5d2bc4c-02bd-46a4-9c13-1f5032380b17 service nova] Creating event network-vif-plugged:3ce57ef8-b241-4169-abac-f60c31bd09b7 for instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 on hv-cinder-83699 Apr 07 17:57:26.610775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-112c418e-96b3-4360-8cae-fdc92dda9a75 req-f5d2bc4c-02bd-46a4-9c13-1f5032380b17 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030812 Apr 07 17:57:26.611377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1192/2250] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:26.619822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:26.620438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:26.627271 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:26.627881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:26.628660 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:26.629316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:26.870082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:26.878876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-d00cb12f-c46e-4691-8f54-d292638ece66 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.263017 Apr 07 17:57:26.879759 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1059/2251] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:26 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:27.897882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:27.902491 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:27.916393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:27.917950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:27.919049 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:27.920548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:28.401528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:28.409896 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-7305e5da-929a-4072-80b0-186b6fc89765 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1358 microversion: 2.1 time: 0.517574 Apr 07 17:57:28.411324 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1193/2252] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:27 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1358 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:29.427366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:29.427984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:29.434303 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:29.434745 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:29.436080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:29.436649 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:29.614600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:29.627481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-890983d9-7c1b-4760-aa8c-2c998f89b522 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1547 microversion: 2.1 time: 0.203747 Apr 07 17:57:29.628434 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1060/2253] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:29 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1547 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:29.644716 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:29.646327 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:29.668502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:29.674490 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:29.681829 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:29.682535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:29.835282 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:29.851092 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-842d4630-a0a5-4670-9de5-7d98b0bc3dad tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1547 microversion: 2.1 time: 0.210259 Apr 07 17:57:29.851682 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1194/2254] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:29 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1547 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:29.867569 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:29.873466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:29.873466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Searching by: {'deleted': False, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c'} {{(pid=117702) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 07 17:57:29.879455 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:29.879910 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:29.880714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:29.881169 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:29.974801 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.multi_cell_list [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117702) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 07 17:57:30.076695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3eef62e5-8d62-41c3-bd4c-6a2ac5e394a6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212934 Apr 07 17:57:30.077306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1061/2255] 10.222.0.26 () {58 vars in 1124 bytes} [Thu Apr 7 17:57:29 2022] GET /compute/v2.1/servers => generated 342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:30.087426 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:30.088048 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:30.094323 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:30.094783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:30.095691 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:30.096258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:30.240603 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:30.248671 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-893b8e1b-1438-4741-bd22-bb05ffcab421 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1547 microversion: 2.1 time: 0.164446 Apr 07 17:57:30.254737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1195/2256] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:30 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:32.042227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3e41e78c-bf78-48a2-8c44-fa1591ecd81a tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Action: 'create', calling method: .version_select at 0x7ff9d055ab80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1101710571", "metadata": {"Type": "work"}}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:32.044222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3e41e78c-bf78-48a2-8c44-fa1591ecd81a tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:32.045618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3e41e78c-bf78-48a2-8c44-fa1591ecd81a tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.117619 Apr 07 17:57:32.046281 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1062/2257] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Apr 7 17:57:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:57:32.055153 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5e201cf5-9fac-473e-881d-19d845c98311 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Action: 'create', calling method: .version_select at 0x7ff9d54e8670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1252734599", "metadata": {"Type": "work"}}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:32.056605 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5e201cf5-9fac-473e-881d-19d845c98311 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:32.057437 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5e201cf5-9fac-473e-881d-19d845c98311 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006158 Apr 07 17:57:32.057951 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1196/2258] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Apr 7 17:57:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 07 17:57:32.067712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-468760fe-122b-41d8-82d4-65ad3731454c tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Action: 'create', calling method: .version_select at 0x7ff9d550aca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-818426585", "metadata": {"Type": "work"}}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:32.068897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-468760fe-122b-41d8-82d4-65ad3731454c tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:32.069726 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-468760fe-122b-41d8-82d4-65ad3731454c tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005834 Apr 07 17:57:32.070229 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1063/2259] 10.222.0.26 () {60 vars in 1155 bytes} [Thu Apr 7 17:57:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 07 17:57:32.079641 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4efb0fbd-cd5e-443e-b24e-26fbb70c2c6a tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Calling method '.version_select at 0x7ff9d5520d30>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:32.107096 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-4efb0fbd-cd5e-443e-b24e-26fbb70c2c6a tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] HTTP exception thrown: Volume tempest-invalid-39482156 could not be found. Apr 07 17:57:32.107881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4efb0fbd-cd5e-443e-b24e-26fbb70c2c6a tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Returning 404 to user: Volume tempest-invalid-39482156 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:32.108725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4efb0fbd-cd5e-443e-b24e-26fbb70c2c6a tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-39482156" status: 404 len: 97 microversion: 2.1 time: 0.033817 Apr 07 17:57:32.109311 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1197/2260] 10.222.0.26 () {58 vars in 1211 bytes} [Thu Apr 7 17:57:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-39482156 => generated 97 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 07 17:57:32.118880 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c417afe8-bf7f-43cf-a727-b3db43df6c89 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003829 Apr 07 17:57:32.119382 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1064/2261] 10.222.0.26 () {58 vars in 1139 bytes} [Thu Apr 7 17:57:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 07 17:57:32.128706 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f6671a39-3d65-4da7-9fbb-0d90017cda0c tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003743 Apr 07 17:57:32.129226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1198/2262] 10.222.0.26 () {58 vars in 1136 bytes} [Thu Apr 7 17:57:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 07 17:57:32.137519 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c9611de-aa65-4f48-b955-58a1a793eea4 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Calling method '.version_select at 0x7ff9d53c6940>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:32.165987 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a27908a9-686e-40d9-bc1b-99a0b723e4a3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "42f250b0-9632-4040-a32b-6e1a9fab0fef"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:32.166179 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-5c9611de-aa65-4f48-b955-58a1a793eea4 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] HTTP exception thrown: Volume ea04eed7-172c-4909-ba59-6d482008e34f could not be found. Apr 07 17:57:32.166646 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5c9611de-aa65-4f48-b955-58a1a793eea4 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Returning 404 to user: Volume ea04eed7-172c-4909-ba59-6d482008e34f could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:32.167046 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a27908a9-686e-40d9-bc1b-99a0b723e4a3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:32.167498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5c9611de-aa65-4f48-b955-58a1a793eea4 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/ea04eed7-172c-4909-ba59-6d482008e34f" status: 404 len: 109 microversion: 2.1 time: 0.033685 Apr 07 17:57:32.168059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1065/2263] 10.222.0.26 () {58 vars in 1247 bytes} [Thu Apr 7 17:57:32 2022] DELETE /compute/v2.1/os-volumes/ea04eed7-172c-4909-ba59-6d482008e34f => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:57:32.173759 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a27908a9-686e-40d9-bc1b-99a0b723e4a3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:32.174215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a27908a9-686e-40d9-bc1b-99a0b723e4a3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:32.175001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a27908a9-686e-40d9-bc1b-99a0b723e4a3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:32.175613 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a27908a9-686e-40d9-bc1b-99a0b723e4a3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:32.177035 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-08338308-9597-4286-819a-44564d86f292 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Calling method '.version_select at 0x7ff9d055a040>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:32.204682 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-08338308-9597-4286-819a-44564d86f292 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] HTTP exception thrown: Volume 1ae88d69-931e-4387-8b78-8ffe59e0504d could not be found. Apr 07 17:57:32.211672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-08338308-9597-4286-819a-44564d86f292 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] Returning 404 to user: Volume 1ae88d69-931e-4387-8b78-8ffe59e0504d could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:57:32.211672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-08338308-9597-4286-819a-44564d86f292 tempest-VolumesNegativeTest-839700132 tempest-VolumesNegativeTest-839700132-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1ae88d69-931e-4387-8b78-8ffe59e0504d" status: 404 len: 109 microversion: 2.1 time: 0.032968 Apr 07 17:57:32.211672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1066/2264] 10.222.0.26 () {58 vars in 1244 bytes} [Thu Apr 7 17:57:32 2022] GET /compute/v2.1/os-volumes/1ae88d69-931e-4387-8b78-8ffe59e0504d => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 07 17:57:32.781678 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a27908a9-686e-40d9-bc1b-99a0b723e4a3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.619598 Apr 07 17:57:32.782332 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1199/2265] 10.222.0.26 () {60 vars in 1322 bytes} [Thu Apr 7 17:57:32 2022] POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:57:40.319068 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:40.319754 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:40.327729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:40.327729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:40.327729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:40.327729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:40.459656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:40.467479 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-949120b7-985a-4ee1-8f31-983a1a51bca3 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1593 microversion: 2.1 time: 0.152846 Apr 07 17:57:40.468047 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1067/2266] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:40 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:42.799467 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-b4366d2e-70f8-4337-a006-e0a282c8593b req-f79d15a6-55ce-4e1f-b962-696a32c1a6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7385f-9b6d-4b80-9e25-a00eac56f8b8", "tag": "3ce57ef8-b241-4169-abac-f60c31bd09b7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:42.810593 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-b4366d2e-70f8-4337-a006-e0a282c8593b req-f79d15a6-55ce-4e1f-b962-696a32c1a6c2 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:42.811073 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-b4366d2e-70f8-4337-a006-e0a282c8593b req-f79d15a6-55ce-4e1f-b962-696a32c1a6c2 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:42.822722 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-b4366d2e-70f8-4337-a006-e0a282c8593b req-f79d15a6-55ce-4e1f-b962-696a32c1a6c2 service nova] Creating event network-changed:3ce57ef8-b241-4169-abac-f60c31bd09b7 for instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 on hv-cinder-83699 Apr 07 17:57:42.828509 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-b4366d2e-70f8-4337-a006-e0a282c8593b req-f79d15a6-55ce-4e1f-b962-696a32c1a6c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033546 Apr 07 17:57:42.829484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1200/2267] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:46.056204 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-28742782"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:46.056747 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:46.063235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:46.063689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:46.064460 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:46.065034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:46.212942 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.network.security_group_api [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Adding security group 704b05d8-e2ad-4fb6-bb38-2d0417ac01ac to port 3ce57ef8-b241-4169-abac-f60c31bd09b7 Apr 07 17:57:46.877296 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fb358a94-8ca7-4b94-9611-d0b450a51bde tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/action" status: 202 len: 0 microversion: 2.1 time: 0.825235 Apr 07 17:57:46.878382 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1068/2268] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:57:46 2022] POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/action => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:57:46.886175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-08a847ee-9f7b-440f-9236-897db6d4b0c1 req-a5f43b03-d034-4536-8627-066535f2b402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7385f-9b6d-4b80-9e25-a00eac56f8b8", "tag": "3ce57ef8-b241-4169-abac-f60c31bd09b7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:46.886760 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:46.887093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:46.901526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:46.901526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:46.901526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:46.901526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:46.908017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-08a847ee-9f7b-440f-9236-897db6d4b0c1 req-a5f43b03-d034-4536-8627-066535f2b402 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:46.910862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-08a847ee-9f7b-440f-9236-897db6d4b0c1 req-a5f43b03-d034-4536-8627-066535f2b402 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:46.944138 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-08a847ee-9f7b-440f-9236-897db6d4b0c1 req-a5f43b03-d034-4536-8627-066535f2b402 service nova] Creating event network-changed:3ce57ef8-b241-4169-abac-f60c31bd09b7 for instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 on hv-cinder-83699 Apr 07 17:57:46.951773 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-08a847ee-9f7b-440f-9236-897db6d4b0c1 req-a5f43b03-d034-4536-8627-066535f2b402 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069858 Apr 07 17:57:46.953239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1201/2269] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:47.087653 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1971407239", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "networks": [{"uuid": "8c291ae0-8fc2-4d76-ac9a-74e87de42662"}]}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:47.131231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:47.143231 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e9704889-6d41-4765-b784-cd41fc16ac23 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1757 microversion: 2.1 time: 0.260627 Apr 07 17:57:47.144983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1069/2270] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:46 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1757 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:47.165892 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.network.neutron [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] validate_networks() for [('8c291ae0-8fc2-4d76-ac9a-74e87de42662', None, None, None, None, None)] {{(pid=117703) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:57:47.540036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Flavor limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:57:47.540461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Image limits 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:57:47.540938 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Flavor pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:57:47.541959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Image pref 0:0:0 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:57:47.541959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.virt.hardware [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117703) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:57:47.553598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:47.554052 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:47.554850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:47.555288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:47.574567 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Getting quotas for project 49fefd0e594a4ffa824b5f88202e5086. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:57:47.579125 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.quota [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Getting quotas for user f372eccc1a5641d39c269c667ebc4cbd and project 49fefd0e594a4ffa824b5f88202e5086. Resources: {'cores', 'ram', 'instances'} {{(pid=117703) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:57:47.590515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Going to run 1 instances... {{(pid=117703) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:57:47.593501 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117703) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:57:47.744761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-0408663d-55dc-4f39-8dc1-7d9d051607b6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663987 Apr 07 17:57:47.749557 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1202/2271] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:57:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:57:47.757612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ffb6b59a-b6a1-4b46-ba89-f34bdf814845 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:47.758360 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ffb6b59a-b6a1-4b46-ba89-f34bdf814845 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:47.809920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ffb6b59a-b6a1-4b46-ba89-f34bdf814845 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:47.816898 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ffb6b59a-b6a1-4b46-ba89-f34bdf814845 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1214 microversion: 2.1 time: 0.064140 Apr 07 17:57:47.817506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1070/2272] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:47 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:48.834710 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:48.835273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:48.841744 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:48.842204 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:48.843751 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:48.844349 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:48.902669 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:48.910990 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-fd2a0a0a-d915-4863-a6db-0f0444db4a8c tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1218 microversion: 2.1 time: 0.080742 Apr 07 17:57:48.911689 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1203/2273] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:48 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:49.928487 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:49.929128 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:49.936235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:49.937317 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:49.938094 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:49.938534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:50.003233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:50.010627 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-559b2129-81f9-48ac-860c-96d28bfb6b07 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1272 microversion: 2.1 time: 0.086033 Apr 07 17:57:50.011191 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1071/2274] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:49 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:51.028043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:51.028666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:51.036100 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:51.036558 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:51.037403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:51.037862 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:51.076535 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-b1c4d889-ecf8-4dca-ae7e-b394a42cde42 req-2782bbed-c7f1-4ccb-84c1-bd14b3640575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2032a788-1863-43f0-8310-fada6afe82d2", "tag": "b4619c37-9027-4475-8648-68aea296c4d3"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:51.084999 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-b1c4d889-ecf8-4dca-ae7e-b394a42cde42 req-2782bbed-c7f1-4ccb-84c1-bd14b3640575 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:51.088852 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-b1c4d889-ecf8-4dca-ae7e-b394a42cde42 req-2782bbed-c7f1-4ccb-84c1-bd14b3640575 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:51.097478 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-b1c4d889-ecf8-4dca-ae7e-b394a42cde42 req-2782bbed-c7f1-4ccb-84c1-bd14b3640575 service nova] Creating event network-changed:b4619c37-9027-4475-8648-68aea296c4d3 for instance 2032a788-1863-43f0-8310-fada6afe82d2 on hv-cinder-83699 Apr 07 17:57:51.105971 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-b1c4d889-ecf8-4dca-ae7e-b394a42cde42 req-2782bbed-c7f1-4ccb-84c1-bd14b3640575 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Apr 07 17:57:51.106614 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1072/2275] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:57:51.180308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:51.188222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-622461cb-1083-4dba-b4ad-3c0498da9ee3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1314 microversion: 2.1 time: 0.164110 Apr 07 17:57:51.192487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1204/2276] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:51 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:52.206897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:52.207591 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:52.213817 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:52.214269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:52.215027 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:52.215462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:52.350213 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:52.357357 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a17863c4-d401-4611-ab23-0bed6946660f tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1314 microversion: 2.1 time: 0.155921 Apr 07 17:57:52.357909 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1073/2277] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:52 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:53.375609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:53.376203 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:53.382565 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:53.383017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:53.383783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:53.384223 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:53.518992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:53.526485 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-87dd1bca-f93f-434d-aaaf-af01f561ff1b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1314 microversion: 2.1 time: 0.155558 Apr 07 17:57:53.527050 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1205/2278] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:53 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:54.543744 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:54.544348 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:54.551139 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:54.551618 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:54.552381 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:54.552819 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:54.689251 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:54.696366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ace3ed64-5b97-4250-81e8-181345cb78bf tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1314 microversion: 2.1 time: 0.156479 Apr 07 17:57:54.696958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1074/2279] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:54 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:55.713544 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:55.714154 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:55.720911 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:55.721407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:55.722170 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:55.722607 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:55.855635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:55.862901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f1595f24-e72c-4160-bbd4-004a1534377e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1314 microversion: 2.1 time: 0.153181 Apr 07 17:57:55.863462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1206/2280] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:55 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:56.728149 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-b9cb0011-d78b-4e09-9c68-58b54a6c79d7 req-91d30e9a-d8fa-42d8-bd88-817503ebeac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2032a788-1863-43f0-8310-fada6afe82d2", "name": "network-vif-plugged", "status": "completed", "tag": "b4619c37-9027-4475-8648-68aea296c4d3"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:57:56.738746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-b9cb0011-d78b-4e09-9c68-58b54a6c79d7 req-91d30e9a-d8fa-42d8-bd88-817503ebeac1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:56.739186 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-b9cb0011-d78b-4e09-9c68-58b54a6c79d7 req-91d30e9a-d8fa-42d8-bd88-817503ebeac1 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:56.750102 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-b9cb0011-d78b-4e09-9c68-58b54a6c79d7 req-91d30e9a-d8fa-42d8-bd88-817503ebeac1 service nova] Creating event network-vif-plugged:b4619c37-9027-4475-8648-68aea296c4d3 for instance 2032a788-1863-43f0-8310-fada6afe82d2 on hv-cinder-83699 Apr 07 17:57:56.755227 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-b9cb0011-d78b-4e09-9c68-58b54a6c79d7 req-91d30e9a-d8fa-42d8-bd88-817503ebeac1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 Apr 07 17:57:56.755927 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1075/2281] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:57:56.879895 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:56.880548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:56.886947 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:56.887403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:56.888181 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:56.888649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:57.025778 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:57.033598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c5d59c24-8ed1-410e-a398-26ca22e2caf7 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1314 microversion: 2.1 time: 0.157426 Apr 07 17:57:57.034421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1207/2282] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:56 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:57:58.051944 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:58.052730 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:58.059304 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:58.059749 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:58.060502 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:58.060928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:58.194515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:58.201811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a88183cb-1a06-4400-931c-c0ccb1aa499e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1314 microversion: 2.1 time: 0.154160 Apr 07 17:57:58.202985 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1076/2283] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:58 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:57:59.218397 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:57:59.219003 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:57:59.225277 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:59.225725 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:59.226487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:57:59.226923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:57:59.362581 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:57:59.369823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2603e004-0e4e-45ef-9451-55268c1f0eac tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1499 microversion: 2.1 time: 0.155507 Apr 07 17:57:59.370413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1208/2284] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:57:59 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:00.172216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:00.172750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:00.179019 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:00.179466 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:00.180238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:00.180694 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:00.204463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Going to try to terminate instance {{(pid=117702) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:58:00.491373 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f2107e4e-4c03-45d4-8457-b4b169094d9e tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 204 len: 0 microversion: 2.1 time: 0.323225 Apr 07 17:58:00.491981 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1077/2285] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:58:00 2022] DELETE /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:58:00.500469 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:00.501465 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:00.507431 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:00.507882 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:00.508635 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:00.509071 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:00.639051 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:00.646409 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-27812833-8d06-4217-ad9c-e3405d4938c2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1505 microversion: 2.1 time: 0.150195 Apr 07 17:58:00.647237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1209/2286] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:00 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:01.134142 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-e0b07ca7-698f-44a3-b1fb-3d55eb38fd08 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:01.135105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-e0b07ca7-698f-44a3-b1fb-3d55eb38fd08 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:01.141086 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0b07ca7-698f-44a3-b1fb-3d55eb38fd08 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:01.141558 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0b07ca7-698f-44a3-b1fb-3d55eb38fd08 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:01.142310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0b07ca7-698f-44a3-b1fb-3d55eb38fd08 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:01.142738 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-e0b07ca7-698f-44a3-b1fb-3d55eb38fd08 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:01.370894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-e0b07ca7-698f-44a3-b1fb-3d55eb38fd08 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/action" status: 202 len: 0 microversion: 2.1 time: 0.240679 Apr 07 17:58:01.371875 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1078/2287] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:58:01 2022] POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:58:01.379582 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:01.380296 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:01.386728 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:01.387105 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:01.387864 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:01.388293 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:01.538643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:01.546998 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-9167ea45-6260-4765-8e0d-5437ddaa8d72 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1749 microversion: 2.1 time: 0.171200 Apr 07 17:58:01.547560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1210/2288] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:01 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1749 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:01.664876 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:01.665600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:01.672173 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:01.672616 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:01.673491 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:01.673928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:01.815984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:01.823662 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9614f714-a9fe-439e-b7e2-1d374327ecde tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1505 microversion: 2.1 time: 0.162959 Apr 07 17:58:01.824235 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1079/2289] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:01 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:02.440213 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-8a16a731-b11e-43fb-8a5f-105832b20aac req-24832daa-dc4d-4e27-b7e9-3201763243f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2032a788-1863-43f0-8310-fada6afe82d2", "name": "network-vif-deleted", "tag": "b4619c37-9027-4475-8648-68aea296c4d3"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:02.448470 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-8a16a731-b11e-43fb-8a5f-105832b20aac req-24832daa-dc4d-4e27-b7e9-3201763243f7 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:02.448918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-8a16a731-b11e-43fb-8a5f-105832b20aac req-24832daa-dc4d-4e27-b7e9-3201763243f7 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:02.460102 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-8a16a731-b11e-43fb-8a5f-105832b20aac req-24832daa-dc4d-4e27-b7e9-3201763243f7 service nova] Creating event network-vif-deleted:b4619c37-9027-4475-8648-68aea296c4d3 for instance 2032a788-1863-43f0-8310-fada6afe82d2 on hv-cinder-83699 Apr 07 17:58:02.465484 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-8a16a731-b11e-43fb-8a5f-105832b20aac req-24832daa-dc4d-4e27-b7e9-3201763243f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029500 Apr 07 17:58:02.466082 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1211/2290] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:58:02.564364 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:02.564928 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:02.571339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:02.572547 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:02.573529 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:02.573967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:02.726951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:02.735456 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-3d04a7c1-18c2-4355-ab08-405359c0c999 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1749 microversion: 2.1 time: 0.175145 Apr 07 17:58:02.736106 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1080/2291] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:02 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1749 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:58:02.842559 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:02.843456 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:02.849714 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:02.850170 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:02.850939 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:02.851379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:02.882462 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:02.882915 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:02.883382 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lazy-loading 'fault' on Instance uuid 2032a788-1863-43f0-8310-fada6afe82d2 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:58:02.926458 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:02.933687 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b96ef361-a414-4466-9c6c-2105352b27e1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 200 len: 1304 microversion: 2.1 time: 0.095909 Apr 07 17:58:02.934245 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1212/2292] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:02 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:03.753440 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:03.754054 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:03.760422 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:03.760867 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:03.761645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:03.762078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:03.915958 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:03.924233 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-119abdc3-79e1-4941-8dec-ec1ec747d338 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.175376 Apr 07 17:58:03.924793 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1081/2293] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:03 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:03.951263 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:03.952466 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 2032a788-1863-43f0-8310-fada6afe82d2] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:03.958919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:03.959370 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:03.960132 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:03.960570 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:03.973783 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] HTTP exception thrown: Instance 2032a788-1863-43f0-8310-fada6afe82d2 could not be found. Apr 07 17:58:03.974369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Returning 404 to user: Instance 2032a788-1863-43f0-8310-fada6afe82d2 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:58:03.975226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f6bbbd3a-2d6a-4494-aa9c-5df4fa48c979 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2" status: 404 len: 111 microversion: 2.1 time: 0.027915 Apr 07 17:58:03.975747 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1213/2294] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:03 2022] GET /compute/v2.1/servers/2032a788-1863-43f0-8310-fada6afe82d2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:58:04.072796 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-589986515", "imageRef": "bf745fd4-fabb-402d-a549-d18ac2c830b1", "flavorRef": "452", "networks": [{"uuid": "8c291ae0-8fc2-4d76-ac9a-74e87de42662"}]}} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:04.120918 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.network.neutron [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] validate_networks() for [('8c291ae0-8fc2-4d76-ac9a-74e87de42662', None, None, None, None, None)] {{(pid=117702) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 07 17:58:04.508105 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Flavor limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 07 17:58:04.508531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Image limits 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 07 17:58:04.509010 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Flavor pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 07 17:58:04.509486 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Image pref 0:0:0 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 07 17:58:04.509901 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.virt.hardware [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117702) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 07 17:58:04.518668 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:04.519119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:04.519929 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:04.520366 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:04.538133 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Getting quotas for project 49fefd0e594a4ffa824b5f88202e5086. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 07 17:58:04.542082 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.quota [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Getting quotas for user f372eccc1a5641d39c269c667ebc4cbd and project 49fefd0e594a4ffa824b5f88202e5086. Resources: {'cores', 'ram', 'instances'} {{(pid=117702) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 07 17:58:04.553557 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Going to run 1 instances... {{(pid=117702) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 07 17:58:04.555829 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bf745fd4-fabb-402d-a549-d18ac2c830b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117702) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 07 17:58:04.676051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-a7d5461f-7e3f-4b7c-a246-c5dd6f3e61af tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607000 Apr 07 17:58:04.676710 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1082/2295] 10.222.0.26 () {60 vars in 1146 bytes} [Thu Apr 7 17:58:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 07 17:58:04.687449 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2a0c3633-d13e-49be-8f16-b4a5526a19ae tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:04.687850 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2a0c3633-d13e-49be-8f16-b4a5526a19ae tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:04.738880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2a0c3633-d13e-49be-8f16-b4a5526a19ae tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:04.745554 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2a0c3633-d13e-49be-8f16-b4a5526a19ae tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1213 microversion: 2.1 time: 0.062472 Apr 07 17:58:04.746215 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1214/2296] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:04 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:04.942152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:04.942757 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:04.948672 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:04.949117 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:04.949905 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:04.950334 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:05.100017 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:05.107792 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b266ff8d-b963-4125-876c-5178487a6578 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.170153 Apr 07 17:58:05.108920 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1083/2297] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:04 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:05.763390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:05.764036 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:05.771891 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:05.772602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:05.773391 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:05.773827 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:05.834421 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:05.841812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ccfa11f1-16ac-4ce4-ad49-3fbc9b34e8e2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1217 microversion: 2.1 time: 0.082284 Apr 07 17:58:05.842424 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1215/2298] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:05 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:06.126170 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:06.126706 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:06.133438 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:06.133881 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:06.134636 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:06.135093 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:06.281431 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:06.292333 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5910fb49-1ff9-4cc1-837f-27ed1f8852d6 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.170417 Apr 07 17:58:06.296332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1084/2299] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:06 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:58:06.865875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:06.865875 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:06.867239 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:06.867695 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:06.868464 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:06.868900 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:06.937365 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:06.944886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c8457393-2a24-41c7-9797-6c38f36b9ab1 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1271 microversion: 2.1 time: 0.089043 Apr 07 17:58:06.945500 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1216/2300] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:06 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:07.310342 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:07.310954 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:07.317800 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:07.318254 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:07.319021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:07.319458 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:07.463825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:07.471941 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f07a26e8-df9b-442b-91d5-3806ff861401 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.165519 Apr 07 17:58:07.472516 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1085/2301] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:07 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:07.962210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:07.962813 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:07.970040 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:07.970487 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:07.971247 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:07.971676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:08.070967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-aab8f377-0f83-40d1-a1f0-1e3c4f07cb88 req-f63c03ef-34ac-4230-8d0d-e4d4c1462040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26435728-da7c-4296-bed3-7e1502702507", "tag": "1697ea26-8c81-4d4e-a5b8-b1456fae36f7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:08.081962 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-aab8f377-0f83-40d1-a1f0-1e3c4f07cb88 req-f63c03ef-34ac-4230-8d0d-e4d4c1462040 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:08.082750 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-aab8f377-0f83-40d1-a1f0-1e3c4f07cb88 req-f63c03ef-34ac-4230-8d0d-e4d4c1462040 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:08.093990 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-aab8f377-0f83-40d1-a1f0-1e3c4f07cb88 req-f63c03ef-34ac-4230-8d0d-e4d4c1462040 service nova] Creating event network-changed:1697ea26-8c81-4d4e-a5b8-b1456fae36f7 for instance 26435728-da7c-4296-bed3-7e1502702507 on hv-cinder-83699 Apr 07 17:58:08.098998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-aab8f377-0f83-40d1-a1f0-1e3c4f07cb88 req-f63c03ef-34ac-4230-8d0d-e4d4c1462040 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031971 Apr 07 17:58:08.099600 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1086/2302] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:58:08.116770 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:08.125853 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-1a982518-23c0-4d11-8e07-3360f2c5b6bb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.167351 Apr 07 17:58:08.126379 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1217/2303] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:07 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:08.491074 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:08.491799 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:08.497996 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:08.498449 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:08.499367 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:08.499811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:08.649719 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:08.659100 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-71e1113f-a9e2-4877-b80a-30f6e9a0c480 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.172679 Apr 07 17:58:08.659680 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1087/2304] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:08 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:09.143543 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:09.144074 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:09.150624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:09.151079 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:09.151842 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:09.152278 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:09.307874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:09.315210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5bb799d6-bbe1-4946-ba38-d288f24108c0 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.176243 Apr 07 17:58:09.315773 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1218/2305] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:09 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:09.676135 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:09.676746 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:09.683021 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:09.683462 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:09.684216 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:09.684645 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:09.830896 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:09.839821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-dc81b007-e041-4efb-a076-6729133f4f6e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.166711 Apr 07 17:58:09.839821 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1088/2306] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:09 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:10.332837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:10.333474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:10.339876 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:10.340329 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:10.341093 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:10.341560 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:10.472258 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:10.479548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f6840463-f3f5-4521-9901-a0a5c4d9bd5b tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.150567 Apr 07 17:58:10.480113 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1219/2307] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:10 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:10.857988 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:10.858661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:10.864916 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:10.865397 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:10.866157 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:10.866586 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:11.008287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:11.016291 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f99351c1-157a-4936-9f21-7c54b595abda tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.162155 Apr 07 17:58:11.016855 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1089/2308] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:10 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:11.496609 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:11.497317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:11.504202 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:11.504651 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:11.505441 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:11.505880 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:11.640571 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:11.648170 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-592ede96-faf8-44e9-978e-9daea908dec3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.155354 Apr 07 17:58:11.648746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1220/2309] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:11 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:12.036883 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:12.037518 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:12.043741 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:12.044187 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:12.044935 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:12.045399 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:12.196030 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:12.203776 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-02eb3942-1ae0-4ee2-a3f5-d66545f2061f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.174810 Apr 07 17:58:12.204342 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1090/2310] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:12 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:12.665374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:12.666027 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:12.672898 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:12.673381 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:12.674165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:12.674604 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:12.810751 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:12.817991 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3e04c338-8891-4b93-a196-ab8fcc340ceb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.156464 Apr 07 17:58:12.818548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1221/2311] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:12 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:13.221507 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:13.222138 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:13.231932 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:13.232379 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:13.233811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:13.234236 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:13.380469 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:13.388218 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-34d61187-7ed2-4095-b599-e7cd1e0a9789 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1754 microversion: 2.1 time: 0.171225 Apr 07 17:58:13.388782 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1091/2312] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:13 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:13.836149 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:13.836755 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:13.843879 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:13.844317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:13.845072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:13.845529 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:13.982064 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:13.990065 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-be2c2d84-e5b1-4098-84b9-2901e2cf2d7a tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.158132 Apr 07 17:58:13.990627 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1222/2313] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:13 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:58:14.406914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:14.407559 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:14.413871 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:14.414324 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:14.415091 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:14.415531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:14.558530 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:14.566931 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-71405722-fc9a-45b9-a769-ce7888f52d1d tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1757 microversion: 2.1 time: 0.164087 Apr 07 17:58:14.567498 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1092/2314] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:14 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:14.831095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-cada2f75-f6d4-4fcd-9a0e-60f7feb6914a req-c9069a34-a668-455a-81f7-c19c0623c21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26435728-da7c-4296-bed3-7e1502702507", "name": "network-vif-plugged", "status": "completed", "tag": "1697ea26-8c81-4d4e-a5b8-b1456fae36f7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:14.839289 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-cada2f75-f6d4-4fcd-9a0e-60f7feb6914a req-c9069a34-a668-455a-81f7-c19c0623c21a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:14.839894 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-cada2f75-f6d4-4fcd-9a0e-60f7feb6914a req-c9069a34-a668-455a-81f7-c19c0623c21a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:14.850428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-cada2f75-f6d4-4fcd-9a0e-60f7feb6914a req-c9069a34-a668-455a-81f7-c19c0623c21a service nova] Creating event network-vif-plugged:1697ea26-8c81-4d4e-a5b8-b1456fae36f7 for instance 26435728-da7c-4296-bed3-7e1502702507 on hv-cinder-83699 Apr 07 17:58:14.855444 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-cada2f75-f6d4-4fcd-9a0e-60f7feb6914a req-c9069a34-a668-455a-81f7-c19c0623c21a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028745 Apr 07 17:58:14.856020 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1223/2315] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:58:15.007826 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:15.008437 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:15.014825 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:15.015290 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:15.016045 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:15.016483 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:15.148951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:15.157118 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5b7e2847-fe82-42d8-9b5a-8c8457e9fec9 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.153146 Apr 07 17:58:15.157712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1093/2316] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:15 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:16.190580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:16.190580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:16.190580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:16.190580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:16.191846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:16.191846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:16.328848 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:16.336180 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3ddb44a1-8678-4e85-bfb0-22ecfd6246f3 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1313 microversion: 2.1 time: 0.165544 Apr 07 17:58:16.336746 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1224/2317] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:16 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:58:17.353823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:17.354457 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:17.361421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:17.361863 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:17.362620 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:17.363048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:17.492763 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:17.500556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9be70513-4141-4389-9a0d-1413b467e1fb tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1498 microversion: 2.1 time: 0.150588 Apr 07 17:58:17.501123 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1094/2318] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:17 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:18.135737 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:18.136281 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:18.143621 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:18.144072 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:18.144830 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:18.145306 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:18.169784 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:58:18.411241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-00fa182c-98ec-411e-a3de-17529c96eac6 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "DELETE /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 204 len: 0 microversion: 2.1 time: 0.279018 Apr 07 17:58:18.411837 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1225/2319] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:58:18 2022] DELETE /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:58:18.420092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:18.420836 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:18.428209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:18.428658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:18.429451 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:18.429882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:18.564346 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:18.571626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-c3f739e3-e172-458c-9b1e-32fdc27257bd tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1504 microversion: 2.1 time: 0.155369 Apr 07 17:58:18.572306 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1095/2320] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:18 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:58:19.590654 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:19.591338 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:19.598959 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:19.599393 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:19.600157 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:19.600590 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:19.736676 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:19.744015 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3d1b5de3-7a6d-4e83-a168-1c2e1ee5e2d4 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1504 microversion: 2.1 time: 0.157546 Apr 07 17:58:19.744583 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1226/2321] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:19 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:20.342080 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-41bf902e-baaa-41a2-9afc-468ecd90ad28 req-5bb85a5b-831f-4841-b586-4a264a9b4f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26435728-da7c-4296-bed3-7e1502702507", "name": "network-vif-deleted", "tag": "1697ea26-8c81-4d4e-a5b8-b1456fae36f7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:20.350412 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-41bf902e-baaa-41a2-9afc-468ecd90ad28 req-5bb85a5b-831f-4841-b586-4a264a9b4f60 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:20.354882 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-41bf902e-baaa-41a2-9afc-468ecd90ad28 req-5bb85a5b-831f-4841-b586-4a264a9b4f60 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:20.361956 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-41bf902e-baaa-41a2-9afc-468ecd90ad28 req-5bb85a5b-831f-4841-b586-4a264a9b4f60 service nova] Creating event network-vif-deleted:1697ea26-8c81-4d4e-a5b8-b1456fae36f7 for instance 26435728-da7c-4296-bed3-7e1502702507 on hv-cinder-83699 Apr 07 17:58:20.366850 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-41bf902e-baaa-41a2-9afc-468ecd90ad28 req-5bb85a5b-831f-4841-b586-4a264a9b4f60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028505 Apr 07 17:58:20.367447 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1096/2322] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:58:20.761428 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:20.762028 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:20.769206 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:20.769655 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:20.770411 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:20.770867 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:20.799874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:20.800317 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:20.800761 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lazy-loading 'fault' on Instance uuid 26435728-da7c-4296-bed3-7e1502702507 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:58:20.839794 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f372eccc1a5641d39c269c667ebc4cbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49fefd0e594a4ffa824b5f88202e5086', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:20.847533 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-844bf2dd-9267-4537-84fc-b14f8aade4ca tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 200 len: 1303 microversion: 2.1 time: 0.090029 Apr 07 17:58:20.848101 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1227/2323] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:20 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:21.866120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:21.866816 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] [instance: 26435728-da7c-4296-bed3-7e1502702507] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:21.872897 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:21.873375 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:21.874752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:21.875182 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:21.888952 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] HTTP exception thrown: Instance 26435728-da7c-4296-bed3-7e1502702507 could not be found. Apr 07 17:58:21.889822 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] Returning 404 to user: Instance 26435728-da7c-4296-bed3-7e1502702507 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:58:21.890629 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-645278ca-a7a7-4f36-bbfd-3ebfbbe88bc2 tempest-VolumesActionsTest-821913493 tempest-VolumesActionsTest-821913493-project] 10.222.0.26 "GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507" status: 404 len: 111 microversion: 2.1 time: 0.029202 Apr 07 17:58:21.891156 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1097/2324] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:21 2022] GET /compute/v2.1/servers/26435728-da7c-4296-bed3-7e1502702507 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:58:46.301698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:46.302341 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:46.308499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:46.309011 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:46.309807 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:46.310250 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:46.338624 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.objects.instance [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lazy-loading 'flavor' on Instance uuid 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 {{(pid=117703) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:58:46.553921 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3e220a5a-66ec-415f-8344-931fb3fb6813 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "POST /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6/action" status: 202 len: 0 microversion: 2.1 time: 0.255805 Apr 07 17:58:46.554475 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1228/2325] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:58:46 2022] POST /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:58:46.563222 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:46.566301 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:46.570055 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:46.570499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:46.571258 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:46.571695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:46.822197 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:46.830435 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f7b98d0c-862e-467a-8a66-4115cb4f6280 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.271710 Apr 07 17:58:46.831104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1098/2326] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:46 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:47.849523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:47.850218 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:47.856148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:47.856595 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:47.857380 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:47.857812 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:48.157707 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:48.165017 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a0d0dd40-8b25-42db-97ff-e0cd49ec0f8c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.320376 Apr 07 17:58:48.165617 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1229/2327] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:47 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:49.182711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:49.183322 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:49.190053 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:49.190505 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:49.191278 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:49.191716 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:49.341809 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:49.349994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9a54025e-95a1-42fb-af2e-d8039b2ccd51 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.171074 Apr 07 17:58:49.355125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1099/2328] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:49 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:49.826251 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-28742782"}} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:49.826849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:49.833885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:49.834336 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:49.835094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:49.835528 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:49.978012 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.network.security_group_api [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Removing security group 704b05d8-e2ad-4fb6-bb38-2d0417ac01ac from port 3ce57ef8-b241-4169-abac-f60c31bd09b7 Apr 07 17:58:50.371993 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:50.373454 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:50.381638 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e99c93b4-0ed4-4b58-b221-2942f363b408 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/action" status: 202 len: 0 microversion: 2.1 time: 0.559186 Apr 07 17:58:50.385217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1230/2329] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:58:49 2022] POST /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:58:50.385509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:50.385509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:50.385509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:50.385509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:50.520846 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-4fb6fbf8-805e-46b5-a0a5-758a445b89f7 req-363c5810-4d1e-4c5f-b73e-635c7847e0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7385f-9b6d-4b80-9e25-a00eac56f8b8", "tag": "3ce57ef8-b241-4169-abac-f60c31bd09b7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:50.537126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-4fb6fbf8-805e-46b5-a0a5-758a445b89f7 req-363c5810-4d1e-4c5f-b73e-635c7847e0d3 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:50.537598 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-4fb6fbf8-805e-46b5-a0a5-758a445b89f7 req-363c5810-4d1e-4c5f-b73e-635c7847e0d3 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:50.563589 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-4fb6fbf8-805e-46b5-a0a5-758a445b89f7 req-363c5810-4d1e-4c5f-b73e-635c7847e0d3 service nova] Creating event network-changed:3ce57ef8-b241-4169-abac-f60c31bd09b7 for instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 on hv-cinder-83699 Apr 07 17:58:50.577852 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-4fb6fbf8-805e-46b5-a0a5-758a445b89f7 req-363c5810-4d1e-4c5f-b73e-635c7847e0d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189238 Apr 07 17:58:50.579874 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1231/2330] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:58:50.639978 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:50.654711 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-90071647-6325-4397-a4ad-3c10ef812115 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.286713 Apr 07 17:58:50.656884 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1100/2331] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:50 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 07 17:58:51.674758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:51.675965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:51.688055 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:51.688835 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:51.689849 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:51.690285 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:51.939226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:51.948106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-e1fcfb5b-7a1f-44e5-993c-5c59942b2848 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.278639 Apr 07 17:58:51.948753 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1232/2332] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:51 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:52.101475 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:52.102034 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:52.108101 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:52.108553 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:52.110079 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:52.110549 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:52.194534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.objects.instance [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lazy-loading 'services' on Instance uuid cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 {{(pid=117702) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 07 17:58:52.388212 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-5fccaf13-fba9-44ee-9297-2fbe570af258 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments/42f250b0-9632-4040-a32b-6e1a9fab0fef" status: 202 len: 0 microversion: 2.1 time: 0.290498 Apr 07 17:58:52.388812 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1101/2333] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:58:52 2022] DELETE /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments/42f250b0-9632-4040-a32b-6e1a9fab0fef => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:58:52.399580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-39a6fec0-f487-4993-814a-55ba0b99708c tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:52.401423 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-39a6fec0-f487-4993-814a-55ba0b99708c tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:52.407659 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39a6fec0-f487-4993-814a-55ba0b99708c tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:52.408106 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39a6fec0-f487-4993-814a-55ba0b99708c tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:52.408923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39a6fec0-f487-4993-814a-55ba0b99708c tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:52.409377 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-39a6fec0-f487-4993-814a-55ba0b99708c tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:52.441616 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-39a6fec0-f487-4993-814a-55ba0b99708c tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048096 Apr 07 17:58:52.442112 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1233/2334] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:58:52 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:58:52.596752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-336769be-9670-470b-9203-902457b6dd57 req-ed2c3652-4aa9-4acb-9e8a-38a2f49288cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdc7385f-9b6d-4b80-9e25-a00eac56f8b8", "tag": "3ce57ef8-b241-4169-abac-f60c31bd09b7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:52.605531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-336769be-9670-470b-9203-902457b6dd57 req-ed2c3652-4aa9-4acb-9e8a-38a2f49288cd service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:52.606058 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-336769be-9670-470b-9203-902457b6dd57 req-ed2c3652-4aa9-4acb-9e8a-38a2f49288cd service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:52.617874 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-336769be-9670-470b-9203-902457b6dd57 req-ed2c3652-4aa9-4acb-9e8a-38a2f49288cd service nova] Creating event network-changed:3ce57ef8-b241-4169-abac-f60c31bd09b7 for instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 on hv-cinder-83699 Apr 07 17:58:52.625878 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-336769be-9670-470b-9203-902457b6dd57 req-ed2c3652-4aa9-4acb-9e8a-38a2f49288cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033849 Apr 07 17:58:52.627951 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1102/2335] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:58:52.966506 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:52.967122 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:52.974914 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:52.975369 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:52.976148 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:52.976611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:53.149133 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:53.158510 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-2683c201-95d5-45e6-8883-3888e2276099 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.195766 Apr 07 17:58:53.159201 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1234/2336] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:52 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:53.455526 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cad7c63f-2ec8-4aec-b511-981e726dc154 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:53.456555 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cad7c63f-2ec8-4aec-b511-981e726dc154 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:53.463534 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cad7c63f-2ec8-4aec-b511-981e726dc154 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:53.468078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cad7c63f-2ec8-4aec-b511-981e726dc154 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:53.468078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cad7c63f-2ec8-4aec-b511-981e726dc154 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:53.468078 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cad7c63f-2ec8-4aec-b511-981e726dc154 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:53.495189 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cad7c63f-2ec8-4aec-b511-981e726dc154 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044608 Apr 07 17:58:53.495772 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1103/2337] 10.222.0.26 () {58 vars in 1301 bytes} [Thu Apr 7 17:58:53 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 07 17:58:53.505968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:53.506517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:53.512551 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:53.513963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:53.513963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:53.514429 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:53.590698 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] HTTP exception thrown: Instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 is not attached to volume 42f250b0-9632-4040-a32b-6e1a9fab0fef Apr 07 17:58:53.591346 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Returning 404 to user: Instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 is not attached to volume 42f250b0-9632-4040-a32b-6e1a9fab0fef {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:58:53.592337 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-ce02476f-4ec2-475e-8f68-8fbb28e37218 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments/42f250b0-9632-4040-a32b-6e1a9fab0fef" status: 404 len: 154 microversion: 2.1 time: 0.090594 Apr 07 17:58:53.592919 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1235/2338] 10.222.0.26 () {58 vars in 1415 bytes} [Thu Apr 7 17:58:53 2022] DELETE /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8/os-volume_attachments/42f250b0-9632-4040-a32b-6e1a9fab0fef => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:58:54.176313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:54.176919 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:54.183294 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:54.183737 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:54.184485 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:54.184912 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:54.324685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:54.333162 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-68b36f9c-ba62-42fb-bfd2-13e29cb583c8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.161126 Apr 07 17:58:54.333728 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1104/2339] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:54 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:54.833718 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:54.834266 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:54.840435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:54.840881 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:54.841668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:54.842107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:54.867088 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 17:58:55.138014 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f0741f2a-fbd7-42a4-aa43-82eec5c7c03e tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 204 len: 0 microversion: 2.1 time: 0.307663 Apr 07 17:58:55.138684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1236/2340] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 17:58:54 2022] DELETE /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 17:58:55.150983 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:55.151713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:55.160052 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:55.160515 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:55.161310 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:55.161789 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:55.310859 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:55.319067 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9d0e7e84-9691-45ae-9eab-61965a5669dd tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1553 microversion: 2.1 time: 0.172536 Apr 07 17:58:55.319656 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1105/2341] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:55 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:55.349886 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:55.350586 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:55.356436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:55.356888 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:55.357684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:55.358126 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:55.495923 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:55.504602 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4edbef34-8435-4f7d-8d72-2d0b19947240 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.158842 Apr 07 17:58:55.505094 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1237/2342] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:55 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:56.336391 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:56.336964 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:56.343361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:56.343814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:56.344568 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:56.345003 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:56.487914 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:56.495110 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1f8ecd9d-395f-41d7-bf27-6db9d16c0404 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1553 microversion: 2.1 time: 0.162639 Apr 07 17:58:56.495669 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1106/2343] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:56 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:56.522535 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:56.523137 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:56.529658 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:56.530107 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:56.530856 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:56.531283 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:56.672383 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:56.680684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-70a45948-5268-4496-87ce-4d9769da664d tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.163027 Apr 07 17:58:56.681267 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1238/2344] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:56 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:57.513316 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:57.514048 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:57.523638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:57.524069 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:57.524894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:57.525354 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:57.611714 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:57.620506 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2026920a-8fd2-4a7a-b46c-ea254e7230e9 tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1511 microversion: 2.1 time: 0.111067 Apr 07 17:58:57.624726 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1107/2345] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:57 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1511 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:57.646508 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [req-efda2121-f3d1-462f-848d-23e49659e267 req-c490fc03-a297-4125-9147-43e2b9e5cb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdc7385f-9b6d-4b80-9e25-a00eac56f8b8", "name": "network-vif-deleted", "tag": "3ce57ef8-b241-4169-abac-f60c31bd09b7"}]} {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:58:57.655918 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-efda2121-f3d1-462f-848d-23e49659e267 req-c490fc03-a297-4125-9147-43e2b9e5cb2a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:57.656322 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [req-efda2121-f3d1-462f-848d-23e49659e267 req-c490fc03-a297-4125-9147-43e2b9e5cb2a service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:57.669611 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.compute.server_external_events [req-efda2121-f3d1-462f-848d-23e49659e267 req-c490fc03-a297-4125-9147-43e2b9e5cb2a service nova] Creating event network-vif-deleted:3ce57ef8-b241-4169-abac-f60c31bd09b7 for instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 on hv-cinder-83699 Apr 07 17:58:57.675013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [req-efda2121-f3d1-462f-848d-23e49659e267 req-c490fc03-a297-4125-9147-43e2b9e5cb2a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032627 Apr 07 17:58:57.675775 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1239/2346] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:58:57.698205 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:57.698808 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:57.705979 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:57.706339 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:57.707189 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:57.707626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:57.844509 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:57.852481 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-253752c2-c605-4afd-8799-9376dd4e6727 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.158060 Apr 07 17:58:57.853046 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1108/2347] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:57 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:58.639037 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:58.639649 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:58.646769 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:58.647443 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:58.648013 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:58.648750 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:58.714531 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f42148ef13141eeb456a7639564f74e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd168a51bad674c2ca599b3e27294fa4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:58.722734 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cb688ace-8fae-42f1-a4ff-4c9fb864f37f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 200 len: 1511 microversion: 2.1 time: 0.088007 Apr 07 17:58:58.723288 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1240/2348] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:58 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:58.870972 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:58.871718 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:58.878353 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:58.878840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:58.879639 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:58.880092 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:59.024219 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:58:59.031807 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-914b111a-841c-42f0-afc4-674c81abb8b4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.164836 Apr 07 17:58:59.032369 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1109/2349] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:58 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:58:59.739731 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:59.740345 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] [instance: cdc7385f-9b6d-4b80-9e25-a00eac56f8b8] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:58:59.751177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:59.751177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:59.751177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:58:59.751177 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:58:59.762555 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.wsgi [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] HTTP exception thrown: Instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 could not be found. Apr 07 17:58:59.763183 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Returning 404 to user: Instance cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 could not be found. {{(pid=117703) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 17:58:59.763999 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f675ade5-b7dd-423a-ab8c-bd366062d9dc tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8" status: 404 len: 111 microversion: 2.1 time: 0.028237 Apr 07 17:58:59.764519 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1241/2350] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:58:59 2022] GET /compute/v2.1/servers/cdc7385f-9b6d-4b80-9e25-a00eac56f8b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 17:58:59.772652 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-81dfaf58-e73e-45e4-9b7e-08058cae897f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] Calling method '.version_select at 0x7ff9d050c8b0>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:58:59.864840 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-81dfaf58-e73e-45e4-9b7e-08058cae897f tempest-TestMinimumBasicScenario-1128334311 tempest-TestMinimumBasicScenario-1128334311-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2094675761" status: 202 len: 0 microversion: 2.1 time: 0.095856 Apr 07 17:58:59.865463 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1110/2351] 10.222.0.26 () {58 vars in 1271 bytes} [Thu Apr 7 17:58:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2094675761 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:59:00.050407 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:00.051062 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:00.057033 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:00.057580 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:00.058413 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:00.058929 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:00.195436 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:00.203241 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-b14804ed-d02e-4398-a6d1-762cf91a8cd9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1570 microversion: 2.1 time: 0.157558 Apr 07 17:59:00.203965 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1242/2352] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:00 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:00.225811 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-fa698000-b573-4603-954d-841962bcb3eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:59:00.226378 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-fa698000-b573-4603-954d-841962bcb3eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:00.232713 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa698000-b573-4603-954d-841962bcb3eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:00.233177 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa698000-b573-4603-954d-841962bcb3eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:00.233946 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa698000-b573-4603-954d-841962bcb3eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:00.234376 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-fa698000-b573-4603-954d-841962bcb3eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:00.494894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-fa698000-b573-4603-954d-841962bcb3eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "POST /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6/action" status: 202 len: 0 microversion: 2.1 time: 0.272783 Apr 07 17:59:00.494894 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1111/2353] 10.222.0.26 () {60 vars in 1277 bytes} [Thu Apr 7 17:59:00 2022] POST /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 17:59:00.503254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:00.504175 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:00.510688 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:00.511210 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:00.512231 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:00.512756 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:00.661226 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:00.669591 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-edd2d247-ee6a-4bc4-87de-9045d123df44 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1578 microversion: 2.1 time: 0.170490 Apr 07 17:59:00.670095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1243/2354] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:00 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:01.687658 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:01.689313 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:01.697499 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:01.699795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:01.699795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:01.699795 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:01.940577 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:01.950574 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-f1613ffc-024b-415a-a235-037d0b23e6eb tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1518 microversion: 2.1 time: 0.267715 Apr 07 17:59:01.951152 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1112/2355] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:01 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1518 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:02.970857 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:02.972058 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:02.988517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:02.988517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:02.988517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:02.988517 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:03.173696 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:03.189933 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-cbb6a47b-62d8-41f1-bcc4-4dd72072fe87 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1520 microversion: 2.1 time: 0.220967 Apr 07 17:59:03.197504 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1244/2356] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:02 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:03.241595 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-966ae69a-5c70-45b1-92f9-974c792a39f5 req-dd2871ff-2f4d-46c7-84b5-5def90c44bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6", "name": "network-vif-unplugged", "status": "completed", "tag": "456e5900-67cf-48e8-9c4b-59a82256ebb7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:59:03.249599 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-966ae69a-5c70-45b1-92f9-974c792a39f5 req-dd2871ff-2f4d-46c7-84b5-5def90c44bb5 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:03.250042 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-966ae69a-5c70-45b1-92f9-974c792a39f5 req-dd2871ff-2f4d-46c7-84b5-5def90c44bb5 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:03.262815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-966ae69a-5c70-45b1-92f9-974c792a39f5 req-dd2871ff-2f4d-46c7-84b5-5def90c44bb5 service nova] Creating event network-vif-unplugged:456e5900-67cf-48e8-9c4b-59a82256ebb7 for instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 on hv-cinder-83699 Apr 07 17:59:03.268062 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-966ae69a-5c70-45b1-92f9-974c792a39f5 req-dd2871ff-2f4d-46c7-84b5-5def90c44bb5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119719 Apr 07 17:59:03.268765 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1113/2357] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 17:59:04.208390 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:04.209758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:04.228316 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:04.228870 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:04.229758 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:04.230195 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:04.633715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:04.633715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5bb0238b-4e20-49e5-a856-78aeec889f79 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.303613 Apr 07 17:59:04.633715 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1245/2358] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:04 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:05.523998 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:05.524690 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:05.531125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:05.531570 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:05.532324 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:05.532755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:05.669974 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:05.677977 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-1a0f4a4e-ca35-4ce6-b59e-cc7b9184e6ad tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.158870 Apr 07 17:59:05.678545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1114/2359] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:05 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:06.695668 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:06.696273 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:06.702639 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:06.703056 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:06.705536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:06.705536 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:06.842001 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:06.849515 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-aa7650fb-e550-4d1e-b8ee-a0e6b645b2c2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.158243 Apr 07 17:59:06.850095 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1246/2360] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:06 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:07.867247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:07.868044 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:07.874626 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:07.875018 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:07.875786 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:07.876223 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:08.032712 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:08.040201 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ce7eae96-b98e-4ac6-a552-a13b32c2a6a9 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.177460 Apr 07 17:59:08.040773 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1115/2361] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:07 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:09.057344 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:09.057963 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:09.064254 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:09.064708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:09.065499 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:09.065984 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:09.201906 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:09.210248 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-f28a4113-f6ed-4555-8ca6-c26d7b8e48b2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.156824 Apr 07 17:59:09.210821 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1247/2362] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:09 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:10.228332 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:10.228945 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:10.235238 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:10.235695 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:10.236453 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:10.236890 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:10.390803 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:10.399331 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-9df8e1b5-58b5-4105-8c72-324e2ae2fcc5 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.174628 Apr 07 17:59:10.399904 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1116/2363] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:10 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:11.416889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:11.417631 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:11.423858 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:11.424303 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:11.425054 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:11.426134 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:11.564962 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:11.573406 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-69319ddf-95a3-4996-bb73-6613ef127be2 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.160426 Apr 07 17:59:11.573970 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1248/2364] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:11 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:12.590122 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:12.590663 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:12.596943 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:12.597930 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:12.598685 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:12.599119 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:12.730814 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:12.738752 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-2cfc7f94-c51d-4119-804e-ec728d273893 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.152513 Apr 07 17:59:12.739307 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1117/2365] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:12 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:13.761374 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:13.762214 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:13.769440 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:13.769701 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:13.770547 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:13.770988 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:13.910872 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:13.918209 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5241df9d-d39d-4578-b4e2-c8f0d0ac09b3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.161518 Apr 07 17:59:13.918777 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1249/2366] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:13 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:14.936403 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:14.937014 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:14.942950 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:14.943398 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:14.944161 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:14.944596 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:15.083066 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:15.090511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-b409d325-70ac-4dc2-82e9-a59ab5d2aebf tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.158122 Apr 07 17:59:15.091081 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1118/2367] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:14 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:16.107901 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:16.108512 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:16.115284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:16.115739 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:16.116511 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:16.116950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:16.257958 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:16.265664 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-5d64b0ed-2736-417b-bb8a-439891f3177b tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.161654 Apr 07 17:59:16.266312 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1250/2368] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:16 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:17.283756 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:17.284427 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:17.291532 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:17.291984 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:17.292748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:17.293247 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:17.432755 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:17.440051 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-25254e0a-50bd-4e85-aefd-51b4ee66fe12 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.160071 Apr 07 17:59:17.440613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1119/2369] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:17 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:18.458274 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:18.458890 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:18.465284 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:18.465735 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:18.466502 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:18.466940 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:18.602847 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:18.610217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-3fb3f416-7fb7-4e46-8580-6a158abc6d4c tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.156056 Apr 07 17:59:18.610795 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1251/2370] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:18 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:19.627370 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:19.628002 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:19.634774 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:19.635203 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:19.635967 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:19.636402 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:19.775261 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:19.782641 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-df367872-1ac4-4de0-b41a-319e15fb7db8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.159131 Apr 07 17:59:19.783209 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1120/2371] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:19 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:20.800666 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:20.801790 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:20.808076 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:20.808520 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:20.809308 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:20.809745 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:20.944077 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:20.951352 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-48f468e7-9fe1-46df-8cdb-ac509c1c7e76 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.154574 Apr 07 17:59:20.951912 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1252/2372] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:20 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:21.536703 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-acf1cebf-2464-4de5-8d13-760f353e35b6 req-0dc73756-c83d-415a-bba5-5744c88f4620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6", "name": "network-vif-plugged", "status": "completed", "tag": "456e5900-67cf-48e8-9c4b-59a82256ebb7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 17:59:21.545181 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-acf1cebf-2464-4de5-8d13-760f353e35b6 req-0dc73756-c83d-415a-bba5-5744c88f4620 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:21.545661 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-acf1cebf-2464-4de5-8d13-760f353e35b6 req-0dc73756-c83d-415a-bba5-5744c88f4620 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:21.556870 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-acf1cebf-2464-4de5-8d13-760f353e35b6 req-0dc73756-c83d-415a-bba5-5744c88f4620 service nova] Creating event network-vif-plugged:456e5900-67cf-48e8-9c4b-59a82256ebb7 for instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 on hv-cinder-83699 Apr 07 17:59:21.561866 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-acf1cebf-2464-4de5-8d13-760f353e35b6 req-0dc73756-c83d-415a-bba5-5744c88f4620 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029362 Apr 07 17:59:21.562444 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1121/2373] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 17:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 17:59:21.968992 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:21.969643 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:21.976548 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:21.976993 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:21.977786 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:21.978217 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:22.108495 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:22.116403 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-c7f67a7c-c7e7-47a2-ac38-3852c41111a3 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1576 microversion: 2.1 time: 0.151213 Apr 07 17:59:22.116968 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1253/2374] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:21 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 17:59:23.135137 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 17:59:23.135830 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 17:59:23.142076 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:23.142517 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:23.143269 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 17:59:23.143696 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 17:59:23.286823 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 17:59:23.294125 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-ed1528ac-c643-4412-80c7-28b9e055a82a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1563 microversion: 2.1 time: 0.163652 Apr 07 17:59:23.294688 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1122/2375] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 17:59:23 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 18:00:37.135016 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 18:00:37.135523 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 18:00:37.136638 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-60a83d63-3fce-42f0-8ef3-808cd49e23c3 req-04c858c0-0344-4922-83d7-10e03780dc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6", "tag": "456e5900-67cf-48e8-9c4b-59a82256ebb7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 18:00:37.141986 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:37.142435 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:37.143222 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:37.143661 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:37.144729 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-60a83d63-3fce-42f0-8ef3-808cd49e23c3 req-04c858c0-0344-4922-83d7-10e03780dc60 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:37.145284 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-60a83d63-3fce-42f0-8ef3-808cd49e23c3 req-04c858c0-0344-4922-83d7-10e03780dc60 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:37.158488 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-60a83d63-3fce-42f0-8ef3-808cd49e23c3 req-04c858c0-0344-4922-83d7-10e03780dc60 service nova] Creating event network-changed:456e5900-67cf-48e8-9c4b-59a82256ebb7 for instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 on hv-cinder-83699 Apr 07 18:00:37.165464 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-60a83d63-3fce-42f0-8ef3-808cd49e23c3 req-04c858c0-0344-4922-83d7-10e03780dc60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032911 Apr 07 18:00:37.166230 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1123/2376] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 07 18:00:37.334809 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Going to try to terminate instance {{(pid=117703) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 07 18:00:37.538256 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-a47e380c-75ab-4a6b-a53a-70b2e7440a7a tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 204 len: 0 microversion: 2.1 time: 0.408789 Apr 07 18:00:37.539080 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1254/2377] 10.222.0.26 () {58 vars in 1238 bytes} [Thu Apr 7 18:00:37 2022] DELETE /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 07 18:00:37.547994 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 18:00:37.548742 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 18:00:37.558166 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:37.558613 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:37.559598 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:37.560033 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:37.704895 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.policy [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117702) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 18:00:37.712895 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-cffcf65c-246c-4788-95f5-f70275d29901 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1569 microversion: 2.1 time: 0.169573 Apr 07 18:00:37.713513 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1124/2378] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 18:00:37 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 18:00:38.735136 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 18:00:38.735823 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 18:00:38.743265 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:38.743708 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:38.744461 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:38.744889 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:38.881237 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 18:00:38.888474 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-4a606ab3-9ec4-4513-b8d1-aa66406f0fd8 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1450 microversion: 2.1 time: 0.157544 Apr 07 18:00:38.889032 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1255/2379] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 18:00:38 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 18:00:39.593081 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [req-caa91c97-cc6b-406f-9c0a-1381370133d2 req-51a17bd2-ebbd-450f-b33d-c2bb6475d420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6", "name": "network-vif-deleted", "tag": "456e5900-67cf-48e8-9c4b-59a82256ebb7"}]} {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 07 18:00:39.601531 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-caa91c97-cc6b-406f-9c0a-1381370133d2 req-51a17bd2-ebbd-450f-b33d-c2bb6475d420 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:39.601966 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [req-caa91c97-cc6b-406f-9c0a-1381370133d2 req-51a17bd2-ebbd-450f-b33d-c2bb6475d420 service nova] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:39.612511 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.compute.server_external_events [req-caa91c97-cc6b-406f-9c0a-1381370133d2 req-51a17bd2-ebbd-450f-b33d-c2bb6475d420 service nova] Creating event network-vif-deleted:456e5900-67cf-48e8-9c4b-59a82256ebb7 for instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 on hv-cinder-83699 Apr 07 18:00:39.617771 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [req-caa91c97-cc6b-406f-9c0a-1381370133d2 req-51a17bd2-ebbd-450f-b33d-c2bb6475d420 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028233 Apr 07 18:00:39.618349 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1125/2380] 10.222.0.26 () {64 vars in 1317 bytes} [Thu Apr 7 18:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 07 18:00:39.905831 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 18:00:39.907043 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.compute.api [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117703) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 18:00:39.913130 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:39.913619 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:39.914442 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:39.914885 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG oslo_concurrency.lockutils [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117703) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:39.981459 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.policy [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dae0de85d01c49dba8bcd98fd2f2d18f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5ec31cb0df4492eaff128c55923a768', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117703) authorize /opt/stack/nova/nova/policy.py:199}} Apr 07 18:00:39.991950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-21beddb1-1fb7-4d3f-9c9e-f6d48d975ba4 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 200 len: 1220 microversion: 2.1 time: 0.089867 Apr 07 18:00:39.992524 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1256/2381] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 18:00:39 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 07 18:00:41.008839 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '>' {{(pid=117702) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 18:00:41.009556 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.compute.api [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [instance: 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6] Fetching instance by UUID {{(pid=117702) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 07 18:00:41.015612 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:41.016059 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:41.016815 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 07 18:00:41.017287 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG oslo_concurrency.lockutils [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Lock "b8571387-67cb-4f0b-96d4-8f5caf004dc2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117702) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 07 18:00:41.030417 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.wsgi [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] HTTP exception thrown: Instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 could not be found. Apr 07 18:00:41.033421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: DEBUG nova.api.openstack.wsgi [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Returning 404 to user: Instance 1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 could not be found. {{(pid=117702) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 07 18:00:41.033421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO nova.api.openstack.requestlog [None req-0c0697a4-b40a-470c-bd01-1491c5a919cd tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6" status: 404 len: 111 microversion: 2.1 time: 0.027695 Apr 07 18:00:41.033421 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: [pid: 117702|app: 0|req: 1126/2382] 10.222.0.26 () {58 vars in 1235 bytes} [Thu Apr 7 18:00:41 2022] GET /compute/v2.1/servers/1c3dad15-5d9a-4ead-a4f6-e8f7e3adf5d6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 07 18:00:41.282726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: DEBUG nova.api.openstack.wsgi [None req-430d1d34-8244-4046-881b-896f7d28af58 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] Calling method '.version_select at 0x7ff9d550adc0>' {{(pid=117703) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 07 18:00:41.282726 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: ERROR oslo.messaging._drivers.impl_rabbit [None req-430d1d34-8244-4046-881b-896f7d28af58 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [890c90cb-3230-47e0-b37c-74e4c914abd4] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 07 18:00:42.285684 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [None req-430d1d34-8244-4046-881b-896f7d28af58 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] [890c90cb-3230-47e0-b37c-74e4c914abd4] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41364. Apr 07 18:00:42.407360 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO nova.api.openstack.requestlog [None req-430d1d34-8244-4046-881b-896f7d28af58 tempest-TestShelveInstance-243474776 tempest-TestShelveInstance-243474776-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1604466148" status: 202 len: 0 microversion: 2.1 time: 1.137255 Apr 07 18:00:42.407950 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: [pid: 117703|app: 0|req: 1257/2383] 10.222.0.26 () {58 vars in 1253 bytes} [Thu Apr 7 18:00:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1604466148 => generated 0 bytes in 1139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 07 18:01:30.819361 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 18:01:30.821689 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 18:01:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 18:02:53.911165 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 18:02:53.911587 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 18:02:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 18:03:26.690000 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 18:03:26.690606 dv-cinder-836996-1-iscsi devstack@n-api.service[117703]: Thu Apr 7 18:03:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 18:03:32.749104 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 18:03:32.749632 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 18:03:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 18:04:29.362843 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 18:04:29.363545 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 18:04:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 07 18:04:50.828120 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 07 18:04:50.828748 dv-cinder-836996-1-iscsi devstack@n-api.service[117702]: Thu Apr 7 18:04:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!